-- Logs begin at Mon 2022-01-10 10:39:38 UTC, end at Mon 2022-01-10 11:59:26 UTC. -- Jan 10 11:28:27.824173 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 10 11:28:27.831667 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 10 11:28:27.833703 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 10 11:28:27 2022] *** Jan 10 11:28:27.833703 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 10 11:28:27.833703 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 10 11:28:27.833703 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: nodename: dv-cinder-master-3-iscsi Jan 10 11:28:27.833703 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: machine: x86_64 Jan 10 11:28:27.833703 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: clock source: unix Jan 10 11:28:27.834132 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: pcre jit disabled Jan 10 11:28:27.834132 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: detected number of CPU cores: 4 Jan 10 11:28:27.834132 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: current working directory: / Jan 10 11:28:27.834132 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: detected binary path: /usr/bin/uwsgi-core Jan 10 11:28:27.834132 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: your processes number limit is 47680 Jan 10 11:28:27.834132 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: your memory page size is 4096 bytes Jan 10 11:28:27.834132 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: detected max file descriptor number: 2048 Jan 10 11:28:27.834132 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: lock engine: pthread robust mutexes Jan 10 11:28:27.834132 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: thunder lock: enabled Jan 10 11:28:27.834132 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 10 11:28:27.834132 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 10 11:28:27.895763 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: Python main interpreter initialized at 0x55edbf71d9c0 Jan 10 11:28:27.895763 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: python threads support enabled Jan 10 11:28:27.895763 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: your server socket listen backlog is limited to 100 connections Jan 10 11:28:27.895763 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: your mercy for graceful operations on workers is 90 seconds Jan 10 11:28:27.896147 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: mapped 403077 bytes (393 KB) for 2 cores Jan 10 11:28:27.896240 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: *** Operational MODE: preforking *** Jan 10 11:28:27.896470 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: *** uWSGI is running in multiple interpreter mode *** Jan 10 11:28:27.896470 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: spawned uWSGI master process (pid: 102591) Jan 10 11:28:27.896678 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 10 11:28:27.897315 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: spawned uWSGI worker 1 (pid: 102592, cores: 1) Jan 10 11:28:27.897657 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: spawned uWSGI worker 2 (pid: 102593, cores: 1) Jan 10 11:28:27.897852 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 10 11:28:29.696360 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 11:28:29.696360 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: from cryptography.utils import int_from_bytes Jan 10 11:28:29.697036 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 11:28:29.697036 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: from cryptography.utils import int_from_bytes Jan 10 11:28:29.701007 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 11:28:29.701007 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: from cryptography.utils import int_from_bytes Jan 10 11:28:29.701509 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 11:28:29.701509 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: from cryptography.utils import int_from_bytes Jan 10 11:28:32.323223 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 10 11:28:32.323950 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 10 11:28:32.324310 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 10 11:28:32.324410 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 10 11:28:32.324494 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 10 11:28:32.324580 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 10 11:28:32.324580 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 10 11:28:32.324737 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 10 11:28:32.324824 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 10 11:28:32.324909 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 10 11:28:32.324988 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.325071 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.325306 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.325407 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.325626 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.325722 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.325943 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.326028 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.326297 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.326388 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.326613 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.326701 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.326941 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.327063 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.327258 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.327347 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.327585 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.327684 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.327851 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.327945 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.328147 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.328233 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.328471 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.328563 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.328792 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.328877 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.329102 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.329258 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.329411 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.329496 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.329731 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.329823 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.330032 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.330171 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.330381 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.330481 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.330688 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.330773 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.331180 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.331280 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.331605 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.331741 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.331910 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.332004 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.332222 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.332317 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.332584 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.332687 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.332875 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.332961 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.333185 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.333271 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.333526 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.333629 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.333820 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.333919 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.334141 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.334273 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.334476 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.334567 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.335395 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.335535 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.335789 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.335939 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.336103 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.336265 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.336423 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.336566 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.336842 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.336949 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.337153 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.337265 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.337462 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.337602 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.337780 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.337878 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.338101 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.338186 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.338441 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.338531 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.338769 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.338905 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.339092 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.339176 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.339410 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.339499 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.339730 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.339828 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.340032 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.340118 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.340339 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.340427 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.340650 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.340746 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.340970 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.341125 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.341275 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.341368 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.341580 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.341666 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.341827 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.341912 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.342133 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.342250 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.342481 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.342576 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.342805 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.342898 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.343141 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.343234 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.343375 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.343463 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.343623 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.343709 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.343943 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.344047 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.344262 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.344349 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.344569 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.344656 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.344877 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.344964 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.345183 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.345268 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.345489 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.345573 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.345794 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.345890 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.346102 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.346187 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.346431 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.346516 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.346738 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.346827 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.347057 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.347164 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.347374 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.347470 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.347691 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.347779 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.347998 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.348084 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.348318 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.348425 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.348714 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.348808 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.348968 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.349063 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.349276 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.349383 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.349611 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.349698 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.349928 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.350020 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.350253 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.351052 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.351236 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.351321 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.351564 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.351649 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.351877 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.351972 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.352188 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.352275 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.352500 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.352585 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.352826 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.352913 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.353163 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.353255 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.353469 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.353563 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.353718 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.353799 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.354010 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.354103 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.354339 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.354453 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.354662 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.354753 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.354970 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.355067 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.355280 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.355373 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.355588 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.355674 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.355891 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.355975 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.356195 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.356288 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.356504 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.356596 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.356809 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.356893 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.357115 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.357211 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.357425 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.357534 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.357728 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.357828 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.358033 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.358137 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.358363 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.358487 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.358670 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.358762 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.358991 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.359097 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.359308 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.359406 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.359615 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.359706 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.359918 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.360022 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.360224 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.360316 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.360530 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.360640 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.360851 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.360954 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.361155 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.361239 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.361459 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.361551 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.361780 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.361873 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.362084 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.362177 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.362417 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.362534 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.362734 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.362828 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.363043 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.363137 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.363347 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.363439 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.363668 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.363756 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.363972 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.364065 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.364277 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.364369 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.364597 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.364685 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.364905 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.364991 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.365213 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.365296 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.365516 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.365608 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.365823 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.365918 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.366387 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.366501 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.366606 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.366743 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.366870 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.367014 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.367180 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.367273 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.367536 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.367632 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.367862 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.367959 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.368120 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.368213 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.368438 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.368524 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.368746 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.368831 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.369056 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.369154 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.369632 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.369725 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:28:32.369969 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.370056 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.370324 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.370427 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.370668 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.370754 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.370985 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.371078 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.371327 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.371434 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.371654 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.371740 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.371973 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.372063 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.372287 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.372376 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.372601 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.372687 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.372929 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.373049 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.373241 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.373335 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.373583 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.373680 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.373864 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.373961 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.374184 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.374333 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.374527 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.374613 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.374856 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.374970 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.375172 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.375261 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.375488 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.375573 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.375805 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.375899 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.376118 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.376206 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.376435 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.376519 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.376761 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.376858 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.377084 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.377176 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.377397 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.377490 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.377740 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.377840 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.378080 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.378184 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.378415 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.378503 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.378746 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.378849 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.379058 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.379144 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.379381 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.379474 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.379696 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.379794 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.380006 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.380097 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.380318 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.380404 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.380653 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.380739 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.380963 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.381051 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.381275 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.381367 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.381624 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.381722 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.381965 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.382051 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.382310 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.382400 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.382669 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.382764 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.382982 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.383066 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.383290 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.383392 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.383599 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.383687 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.383906 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.383990 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.384224 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.384318 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.384552 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.384645 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.384860 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.384955 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.385194 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.385289 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.385502 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.385587 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.385810 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.385902 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.386122 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.386240 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.386448 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.386532 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.386760 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.386856 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.387073 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.387167 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.387379 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.387464 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.387703 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.387843 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.388013 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.388153 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.388321 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.388407 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.388642 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.388728 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.388948 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.389041 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.389256 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.389349 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.389576 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.389663 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.389890 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.389978 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.390201 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.390325 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.390535 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.390620 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.390860 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.390998 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.391171 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.391258 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.391481 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.391576 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.391814 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.391899 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.392145 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.392237 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.392452 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.392547 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.392778 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.392870 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.393100 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.393187 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.393416 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.393514 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.393724 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.393810 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.394033 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.394118 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.394364 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.394467 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.394669 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.394754 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.394975 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.395058 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.395282 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.395375 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.395587 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.395681 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.395892 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.396002 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.396194 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.396288 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.396497 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.396583 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.396800 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.396885 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.397125 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.397218 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.397944 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.398030 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.398296 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.398407 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.398607 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.398693 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.398923 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.399009 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.399273 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.399369 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.399583 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.399669 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.399926 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.400012 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.400262 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.400355 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.400606 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.400697 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.400904 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.400990 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.401216 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.401310 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.401532 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.401619 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.401845 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.401937 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.402159 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.402308 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.402495 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.402582 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.402808 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.402977 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.403127 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.403223 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.403435 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.403522 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.403753 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.403845 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.404062 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.404148 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.404387 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.404472 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.404696 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.404781 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.405015 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.405102 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.405318 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.405404 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.405634 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.405719 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.405973 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.406058 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.406325 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.406415 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.406643 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.406729 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.406968 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.407054 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.407279 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.407365 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.407593 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.407691 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.407900 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.408023 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.408211 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.408309 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.408521 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.408626 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.408829 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.408917 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.409153 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.409244 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.409459 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.409553 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.409777 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.409864 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.410086 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.410181 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.410454 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.410554 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.410765 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.410850 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.411081 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.411218 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.411389 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.411483 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.411707 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.411794 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.412038 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.412124 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.412374 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.412460 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.412688 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.412782 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.413123 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.413276 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.413447 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.413586 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.413757 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.413913 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.414068 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.414266 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.414412 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.414574 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.414720 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.414887 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.415028 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.415216 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.415343 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.415517 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.415659 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.415842 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.415970 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.416159 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.416281 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.416475 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.416587 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.416786 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.416902 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.417104 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.417213 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.417417 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.417502 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.417728 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.417813 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.418037 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.418173 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.418377 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.418465 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.418706 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.418794 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.419027 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.419114 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.419354 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.419449 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.419661 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.419756 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.419965 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.420053 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.420273 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.420358 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.420586 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.420685 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.420889 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.420975 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.421193 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.421323 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.421496 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.421591 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.421832 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.421917 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.422141 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.422252 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.422472 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.422569 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.422789 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.422876 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.423109 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.423194 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.423418 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.423513 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.423731 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.423816 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.424041 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.424133 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.424351 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.424438 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.424663 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.424747 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.424976 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.425061 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.425284 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.425371 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.425595 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.425681 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.425905 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.425989 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.426228 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.426315 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.426545 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.426630 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.426860 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.426956 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.427174 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.427272 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.427476 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.427569 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.427784 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.427883 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.428090 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.428214 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.428396 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.428515 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.428837 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.429110 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.429246 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.429690 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.429820 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.430027 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.430160 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.430372 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.430505 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.430696 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.430831 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.431020 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.431156 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.431338 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.431497 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.431672 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.431799 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.432000 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.432132 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.432313 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.432449 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.432620 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.432757 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.432930 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.433069 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.433236 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.433379 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.433544 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.433674 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.433856 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.433991 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.434160 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.434322 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.434560 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.434646 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.434867 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.434955 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.435176 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.435269 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.435482 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.435572 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.435788 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.435876 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.436130 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.436216 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.436436 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.436530 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.436753 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.436848 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.437060 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.437159 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.437368 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.437461 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.437674 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.437766 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.437997 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.438083 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.438331 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.438421 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.438639 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.438725 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.438945 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.439034 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.439252 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.439338 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.439595 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.439680 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.439900 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.440084 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.440237 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.440324 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.440563 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.440656 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.440901 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.440989 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.441208 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.441304 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.441514 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.441607 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.441834 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.441920 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.442141 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.442279 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.442471 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.442569 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.442775 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.442862 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.443083 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.443169 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.443392 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.443492 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.443697 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.443828 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.444005 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.444097 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.444827 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.445047 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.445134 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.445383 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.445475 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.445705 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.445799 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.446017 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.446134 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.446340 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.446441 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.446655 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.446750 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.446979 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.447071 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.447265 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.447351 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.447568 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.447664 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.447876 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.447976 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.448182 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.448270 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.448485 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.448581 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.448790 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.448875 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.449093 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.449178 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.449430 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.449518 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.449698 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.449785 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.450001 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.450088 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.450330 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.450423 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.450638 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.450726 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.450943 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.451028 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.451288 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.451385 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.451548 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.451633 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.451860 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.451954 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.452167 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.452263 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.452468 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.452554 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.452773 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.452872 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.453074 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.453161 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.453374 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.453460 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.453676 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.453772 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.453989 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.454078 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.454321 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.454410 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.454629 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.454730 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.454939 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.455027 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.455242 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.455328 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.455545 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.455639 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.455845 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.455938 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.456150 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.456235 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.456449 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.456550 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.456751 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.456838 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.457051 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.457138 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.457353 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.457447 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.457654 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.457740 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.457976 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.458075 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.458305 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.458397 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.458609 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.458705 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.458913 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.458997 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.459218 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.459307 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.459529 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.459620 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.459997 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.460099 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.460309 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.460467 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.460759 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.460848 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.461077 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.461180 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.461401 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.461495 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.461714 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.461801 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.462026 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.462121 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.462361 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.462449 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.462668 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.462753 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.462980 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.463077 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.463290 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.463376 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.463601 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.463686 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.463905 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.464111 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.464197 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.464276 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.464510 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.464597 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.464818 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.464905 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.465127 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.465213 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.465441 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.465545 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.465758 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.465847 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.466081 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.466166 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.466446 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.466538 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.466759 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.466847 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.467070 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.467156 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.467380 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.467467 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.467689 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.467775 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.467997 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.468082 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.468304 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.468397 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.468615 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.468756 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.468932 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.469024 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.469238 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.469336 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.469548 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.469635 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.469855 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.469941 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.470164 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.470311 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.470497 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.470585 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.470802 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.470888 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.471108 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.471202 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.471423 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.471509 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.471727 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.471866 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.472034 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.472121 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.472335 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.472428 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.472642 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.472727 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.472944 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.473031 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.473252 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.473385 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.473684 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.473777 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.473992 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.474122 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.474326 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.474815 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.474902 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.474969 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.475048 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.475235 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.475321 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.476091 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.476281 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.476409 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.476630 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.476716 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.476944 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.477119 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.477367 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.477461 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.477684 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.477780 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.478001 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.478088 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.478335 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.478443 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.478642 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.478728 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.478949 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.479033 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.479263 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.479366 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.479564 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.479665 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.479868 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.479962 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.480169 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.480265 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.480478 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.480563 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.480781 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.480880 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.481103 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.481217 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.481431 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.481542 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.481891 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.482003 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.482121 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.482264 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.482489 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.482823 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.482918 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.483137 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.483231 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.483451 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.483544 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.483775 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.483868 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.484168 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.484274 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.484421 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.484520 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.484730 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.484818 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.485042 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.485141 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.485350 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.485441 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.485673 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.485772 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.485995 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.486087 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.486326 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.486419 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.486639 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.486741 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.486943 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.487036 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.487265 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.487358 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.487587 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.487689 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.487905 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.487996 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.488226 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.488318 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.488640 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.488741 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.488966 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.489084 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.489293 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.489386 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.489592 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.489687 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.489916 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.490023 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.490245 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.490340 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.490553 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.490646 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.490863 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.490974 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.491772 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.491871 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.492036 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.492123 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.492381 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.492482 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.492680 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.492769 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.492957 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.493051 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.493266 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.493360 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.493575 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.493677 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.493879 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.493981 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.494251 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.494593 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.494774 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.494863 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.495073 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.495168 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.495395 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.495498 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.495709 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.495803 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.496029 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.496123 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.496349 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.496442 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.496653 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.496754 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.496976 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.497079 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.497285 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.497378 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.497587 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.497679 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.497891 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.497993 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.498192 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.498309 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.498558 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.498653 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.498864 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.498965 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.499182 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.499282 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.499513 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.499619 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.500186 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.500296 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.500372 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.500440 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.500507 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.500580 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.500904 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.501000 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.501071 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.501139 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.501388 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.501533 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.501688 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.501836 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.501982 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.502246 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.502403 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.502552 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.502710 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.502868 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.503035 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.503184 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.503378 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.503539 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.503696 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.503844 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.503996 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.504144 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.504896 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.505048 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.505048 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.505342 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.505511 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.505659 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.505856 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.505856 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.506142 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.506314 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.506463 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.506610 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.506791 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.507033 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.507284 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.507441 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.507596 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.507759 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.507923 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.508070 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.508070 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.508346 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.508514 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.508678 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.508826 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.508972 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.509117 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.509263 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.509408 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.509563 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.509721 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.509868 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.510013 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.510160 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.510321 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.510442 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.510537 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.510620 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.510701 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.510789 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.510887 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.511082 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.511171 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.511251 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.511331 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.511410 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.511503 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.511586 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.511785 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.511875 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.512105 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.512193 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.512431 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.512551 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.512751 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.512858 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.513179 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.513317 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.513498 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.513651 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.513970 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.514056 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.514315 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.514406 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.514637 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.514737 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.514970 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.515071 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.515291 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.515386 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.515603 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.515690 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.515917 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.516005 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.516228 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.516324 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.516540 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.516627 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.516850 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.516937 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.517161 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.517260 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.517494 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.517580 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.517817 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.517904 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.518138 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.518239 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.518482 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.518569 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.518800 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.518887 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.519117 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.519273 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.519433 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.519519 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.519751 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.519923 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.520086 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.520173 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.520409 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.520502 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.520714 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.520812 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.521029 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.521126 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.521341 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.521427 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.521653 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.521747 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.521965 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.522053 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.522337 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.522471 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.522659 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.522758 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.522974 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.523062 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.523293 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.523380 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.523609 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.523698 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.523937 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.524024 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.524259 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.524354 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.524586 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.524721 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.524903 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.524991 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.525220 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.525322 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.525534 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.525621 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.525846 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.526053 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.526164 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.526417 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.526708 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.526795 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.527025 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.527122 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.527358 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.527462 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.527686 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.527773 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.528000 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.528085 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.528316 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.528415 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.528629 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.528714 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.528940 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.529026 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.529252 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.529394 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.529559 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.529646 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.529867 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.529977 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.530173 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.530291 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.530523 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.530622 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.530835 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.530929 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.531160 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.531258 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.531466 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.531564 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.531783 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.531997 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.532086 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.532350 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.532604 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.532692 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.532951 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.533046 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.533267 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.533353 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.533593 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.533682 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.533920 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.534035 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.534245 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.534334 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.534549 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.534636 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.534858 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.534961 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.535162 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.535248 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.535467 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.535556 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.535773 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.535867 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.536079 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.536165 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.536382 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.536477 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.536688 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.536777 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.536992 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.537078 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.537299 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.537386 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.537600 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.537688 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.538474 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.538596 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.538783 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.538872 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.539109 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.539313 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.539420 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.539629 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.539724 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.539950 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.540049 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.540258 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.540344 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.540567 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.540662 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.540880 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.540997 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.541183 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.541269 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.541488 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.541582 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.541795 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.541897 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.542095 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.542181 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.542430 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.542517 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.542743 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.542911 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.543051 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.543140 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.543352 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.543447 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.543658 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.543744 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.543959 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.544044 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.544280 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.544373 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.544581 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.544667 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.544884 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.544977 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.545198 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.545293 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.545507 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.545593 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.545824 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.545911 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.546133 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.546246 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.546471 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.546567 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.546812 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.546900 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.547126 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.547343 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.547655 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.547744 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.548039 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.548124 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.548360 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.548448 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.548704 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.548793 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.549026 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.549119 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.549337 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.549427 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.549645 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.549738 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.549969 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.550109 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.550306 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.550391 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.550605 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.550701 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.550916 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.551011 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.551228 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.551315 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.551537 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.551624 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.551846 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.551951 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.552157 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.552250 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.552465 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.552556 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.552779 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.552887 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.553086 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.553174 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.553403 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.553524 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.554303 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.554621 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.554758 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.554948 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.555083 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.555270 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.555371 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.555594 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.555681 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.555910 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.555997 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.556225 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.556321 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.556540 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.556636 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.556855 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.556943 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.557171 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.557264 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.557527 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.557629 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.557813 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.557908 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.558118 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.558206 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.558563 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.558651 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.558878 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.558965 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.559197 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.559284 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.559517 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.559612 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.559829 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.559926 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.560152 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.560238 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.560474 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.560563 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.560783 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.560879 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.561105 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.561191 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.561414 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.561500 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.561741 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.561840 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.562078 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.562300 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.562429 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.562518 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.562753 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.562843 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.563059 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.563156 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.563362 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.563457 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.563666 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.563754 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.563976 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.564063 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.564304 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.564390 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.564636 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.564724 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.564948 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.565042 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.565273 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.565360 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.565580 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.565668 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.565902 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.565987 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.566228 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.566329 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.566550 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.566637 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.566869 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.566956 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.567183 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.567279 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.567491 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.567586 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.567821 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.567908 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.568130 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.568227 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.568440 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.568527 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.568750 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.568836 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.569060 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.569203 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.569462 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.569553 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.569780 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.569904 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.570106 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.570205 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.570459 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.570551 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.570769 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.570869 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.571098 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.571187 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.571425 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.571513 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.571743 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.571837 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.572059 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.572146 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.572369 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.572459 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.572699 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.572796 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.573007 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.573107 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.573368 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.573472 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.573631 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.573733 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.573940 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.574027 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.574278 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.574381 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.574596 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.574696 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.574930 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.575018 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.575257 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.575353 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.575584 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.575673 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.575911 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.575997 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.576254 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.576348 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.576569 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.576657 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.576912 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.576998 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.577239 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.577333 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.577551 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.577638 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.577862 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.577948 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.578164 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.578276 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:28:32.578432 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 10 11:28:32.578520 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 10 11:28:32.602617 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_db.sqlalchemy.engines [None req-065cef0d-daa4-468d-94d0-1e1c99c3cb87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:28:32.603597 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG oslo_db.sqlalchemy.engines [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:28:32.671842 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.context [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b04a23e9-a80a-461f-a3e7-7cc1d42b02ad(cell1) {{(pid=102592) load_cells /opt/stack/nova/nova/context.py:464}} Jan 10 11:28:32.672789 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.context [None req-065cef0d-daa4-468d-94d0-1e1c99c3cb87 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b04a23e9-a80a-461f-a3e7-7cc1d42b02ad(cell1) {{(pid=102593) load_cells /opt/stack/nova/nova/context.py:464}} Jan 10 11:28:32.676041 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:28:32.676964 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-065cef0d-daa4-468d-94d0-1e1c99c3cb87 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:28:32.677650 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:28:32.678483 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:28:32.678656 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-065cef0d-daa4-468d-94d0-1e1c99c3cb87 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:28:32.679481 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-065cef0d-daa4-468d-94d0-1e1c99c3cb87 None None] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:28:32.681132 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG oslo_concurrency.lockutils [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:28:32.681434 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-065cef0d-daa4-468d-94d0-1e1c99c3cb87 None None] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:28:32.691591 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG oslo_db.sqlalchemy.engines [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:28:32.694708 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG oslo_db.sqlalchemy.engines [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:28:32.697825 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_db.sqlalchemy.engines [None req-065cef0d-daa4-468d-94d0-1e1c99c3cb87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:28:32.700333 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_db.sqlalchemy.engines [None req-065cef0d-daa4-468d-94d0-1e1c99c3cb87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:28:32.870088 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG oslo_db.sqlalchemy.engines [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:28:32.872787 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_db.sqlalchemy.engines [None req-065cef0d-daa4-468d-94d0-1e1c99c3cb87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:28:33.279590 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: WARNING keystonemiddleware.auth_token [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 10 11:28:33.286307 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: WARNING keystonemiddleware.auth_token [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 10 11:28:33.322423 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: WARNING keystonemiddleware.auth_token [None req-065cef0d-daa4-468d-94d0-1e1c99c3cb87 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 10 11:28:33.329091 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: WARNING keystonemiddleware.auth_token [None req-065cef0d-daa4-468d-94d0-1e1c99c3cb87 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 10 11:28:33.640557 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: WARNING keystonemiddleware.auth_token [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 10 11:28:33.645737 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: WARNING keystonemiddleware.auth_token [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 10 11:28:33.651399 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55edbf71d9c0 pid: 102592 (default app) Jan 10 11:28:33.653455 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:28:33.654643 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001713 Jan 10 11:28:33.655058 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Mon Jan 10 11:28:33 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:28:33.672527 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: WARNING keystonemiddleware.auth_token [None req-065cef0d-daa4-468d-94d0-1e1c99c3cb87 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 10 11:28:33.677884 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: WARNING keystonemiddleware.auth_token [None req-065cef0d-daa4-468d-94d0-1e1c99c3cb87 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 10 11:28:33.683393 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55edbf71d9c0 pid: 102593 (default app) Jan 10 11:30:08.608976 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:30:08.610711 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002011 Jan 10 11:30:08.611648 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jan 10 11:30:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:30:09.088632 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-bad38392-05fe-4f5c-98eb-56cca5dc48ea admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:30:09.124252 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-bad38392-05fe-4f5c-98eb-56cca5dc48ea admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.504841 Jan 10 11:30:09.125235 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Jan 10 11:30:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:30:11.639356 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:30:11.640815 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-6ae6ba17-36eb-4960-bd2d-9f64dbbbab7e None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002052 Jan 10 11:30:11.641767 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jan 10 11:30:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:30:11.707666 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-2584a10c-9aa4-4846-aba4-004e8e9929f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "rxtx_factor": 1.0, "ram": 256}} {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:11.726557 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:30:11.726557 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: warnings.warn(msg) Jan 10 11:30:11.904801 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-2584a10c-9aa4-4846-aba4-004e8e9929f0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.256250 Jan 10 11:30:11.906241 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jan 10 11:30:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:30:12.147826 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-965627c2-417f-4d73-9a14-6640f7bb3007 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:12.150239 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:30:12.150239 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: warnings.warn(msg) Jan 10 11:30:12.321874 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-965627c2-417f-4d73-9a14-6640f7bb3007 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.406585 Jan 10 11:30:12.340757 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jan 10 11:30:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:30:14.914440 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-2584a10c-9aa4-4846-aba4-004e8e9929f0 admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:30:14.915552 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-2584a10c-9aa4-4846-aba4-004e8e9929f0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Jan 10 11:30:14.916040 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jan 10 11:30:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:30:15.039660 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-994632ea-8f7b-4669-b60b-0b75cd98aec2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "name": "ds512M", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:15.059547 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:30:15.059547 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: warnings.warn(msg) Jan 10 11:30:15.307135 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-994632ea-8f7b-4669-b60b-0b75cd98aec2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.384686 Jan 10 11:30:15.307905 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jan 10 11:30:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:30:15.319930 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-b607adff-04a1-4288-a7a8-5945d9c1ed9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:15.321404 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:30:15.321404 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: warnings.warn(msg) Jan 10 11:30:15.490205 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-b607adff-04a1-4288-a7a8-5945d9c1ed9c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.173707 Jan 10 11:30:15.491024 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jan 10 11:30:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:30:18.063341 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-994632ea-8f7b-4669-b60b-0b75cd98aec2 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:30:18.063341 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-994632ea-8f7b-4669-b60b-0b75cd98aec2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jan 10 11:30:18.063341 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jan 10 11:30:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:30:18.141980 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-bc1142d2-e2a7-4585-8de8-16d9515f3dfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:18.291929 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-bc1142d2-e2a7-4585-8de8-16d9515f3dfc admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.214946 Jan 10 11:30:18.291929 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jan 10 11:30:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:30:18.295784 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-066e9186-1277-4767-9fb7-d426e3e8734d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:18.444486 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-066e9186-1277-4767-9fb7-d426e3e8734d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.152410 Jan 10 11:30:18.466712 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jan 10 11:30:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:30:20.975279 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-bc1142d2-e2a7-4585-8de8-16d9515f3dfc admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:30:20.976448 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-bc1142d2-e2a7-4585-8de8-16d9515f3dfc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Jan 10 11:30:20.980720 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jan 10 11:30:20 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:30:21.059704 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-87b1eed6-db5e-4e8d-bcde-7c182c7716ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:21.217508 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-87b1eed6-db5e-4e8d-bcde-7c182c7716ef admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.231816 Jan 10 11:30:21.218176 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jan 10 11:30:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:30:21.230557 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-a9bfc5ba-af31-4655-ba0a-cbce9f9b73e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:21.332564 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-a9bfc5ba-af31-4655-ba0a-cbce9f9b73e6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106017 Jan 10 11:30:21.333234 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jan 10 11:30:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:30:23.828342 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-87b1eed6-db5e-4e8d-bcde-7c182c7716ef admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:30:23.829345 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-87b1eed6-db5e-4e8d-bcde-7c182c7716ef admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jan 10 11:30:23.829902 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jan 10 11:30:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:30:23.893001 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-cb84565f-8893-48cd-a2bf-2fed8b1d46cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:24.003066 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-cb84565f-8893-48cd-a2bf-2fed8b1d46cf admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.167206 Jan 10 11:30:24.004040 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jan 10 11:30:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:30:24.015314 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-17378821-3bb6-444c-b9d1-86c716ec9e4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:24.269232 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-17378821-3bb6-444c-b9d1-86c716ec9e4c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.257368 Jan 10 11:30:24.269885 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Mon Jan 10 11:30:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:30:26.916210 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-cb84565f-8893-48cd-a2bf-2fed8b1d46cf admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:30:26.917217 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-cb84565f-8893-48cd-a2bf-2fed8b1d46cf admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jan 10 11:30:26.917616 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jan 10 11:30:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:30:26.985994 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-75f197ef-fe63-4084-8e1d-9bdd08685437 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:30:27.010959 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-75f197ef-fe63-4084-8e1d-9bdd08685437 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086525 Jan 10 11:30:27.011760 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Jan 10 11:30:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:30:29.650613 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-cb84565f-8893-48cd-a2bf-2fed8b1d46cf admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:30:29.651629 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-cb84565f-8893-48cd-a2bf-2fed8b1d46cf admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jan 10 11:30:29.652209 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jan 10 11:30:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:30:29.732985 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-2ca5b3a7-1601-4df2-a240-8ed0caf695cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "ram": 512, "swap": 0}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:29.924160 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-2ca5b3a7-1601-4df2-a240-8ed0caf695cf admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.264580 Jan 10 11:30:29.925205 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jan 10 11:30:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:30:29.945251 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-768afbc7-6cc2-4567-833b-e2ce2ea20721 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:30.123216 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-768afbc7-6cc2-4567-833b-e2ce2ea20721 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.189079 Jan 10 11:30:30.123843 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jan 10 11:30:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:30:32.846970 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-2ca5b3a7-1601-4df2-a240-8ed0caf695cf admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:30:32.848799 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-2ca5b3a7-1601-4df2-a240-8ed0caf695cf admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002382 Jan 10 11:30:32.849669 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jan 10 11:30:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:30:32.915154 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-1fc7c9cc-e6bb-404a-b4f6-aeeefcc64e17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "disk": 20, "vcpus": 1, "name": "m1.small"}} {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:33.028423 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-1fc7c9cc-e6bb-404a-b4f6-aeeefcc64e17 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.172362 Jan 10 11:30:33.030390 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jan 10 11:30:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:30:33.041220 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-d55ed8a7-c39f-4b03-996b-7cccff7b862b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:33.197652 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-d55ed8a7-c39f-4b03-996b-7cccff7b862b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.160116 Jan 10 11:30:33.198567 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jan 10 11:30:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:30:35.892480 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-1fc7c9cc-e6bb-404a-b4f6-aeeefcc64e17 admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:30:35.893492 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-1fc7c9cc-e6bb-404a-b4f6-aeeefcc64e17 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jan 10 11:30:35.894428 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jan 10 11:30:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:30:36.016986 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-e0df149e-037a-406f-9151-eeef6a77138f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "ram": 4096, "disk": 40}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:36.175322 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-e0df149e-037a-406f-9151-eeef6a77138f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.274833 Jan 10 11:30:36.190859 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-31789a38-2cc5-4091-b8c6-f8b208d94e73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:36.196437 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jan 10 11:30:35 2022] POST /compute/v2.1/flavors => generated 406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:30:36.321867 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-31789a38-2cc5-4091-b8c6-f8b208d94e73 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.133726 Jan 10 11:30:36.322965 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jan 10 11:30:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:30:38.965580 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-e0df149e-037a-406f-9151-eeef6a77138f admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:30:38.967550 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-e0df149e-037a-406f-9151-eeef6a77138f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001832 Jan 10 11:30:38.968019 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jan 10 11:30:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:30:39.036239 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-e17bf520-7e75-46ef-80e2-101522a2b208 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "vcpus": 4, "swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:39.319285 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-e17bf520-7e75-46ef-80e2-101522a2b208 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.343776 Jan 10 11:30:39.333018 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-5efa8211-f46a-483b-aa0e-14f2b057e68d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:39.338429 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jan 10 11:30:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:30:39.450247 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-5efa8211-f46a-483b-aa0e-14f2b057e68d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120995 Jan 10 11:30:39.451584 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jan 10 11:30:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:30:42.004611 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-e17bf520-7e75-46ef-80e2-101522a2b208 admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:30:42.006448 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-e17bf520-7e75-46ef-80e2-101522a2b208 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002219 Jan 10 11:30:42.012323 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jan 10 11:30:42 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:30:42.078253 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-2249ed6c-3aef-4f41-b719-313a33d20564 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "id": "5", "disk": 160}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:42.260970 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-2249ed6c-3aef-4f41-b719-313a33d20564 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.246807 Jan 10 11:30:42.261523 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Mon Jan 10 11:30:42 2022] POST /compute/v2.1/flavors => generated 408 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:30:42.277599 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-3c56d785-e036-4db9-95ea-6b6de86e0ce6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:30:42.438890 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-3c56d785-e036-4db9-95ea-6b6de86e0ce6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.164502 Jan 10 11:30:42.450306 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Mon Jan 10 11:30:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:31:04.282112 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-2249ed6c-3aef-4f41-b719-313a33d20564 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:04.283166 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-2249ed6c-3aef-4f41-b719-313a33d20564 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jan 10 11:31:04.283586 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jan 10 11:31:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:31:04.341278 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-ab776e32-21cd-4df1-908e-142306a954b8 admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:04.358247 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-ab776e32-21cd-4df1-908e-142306a954b8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068491 Jan 10 11:31:04.358785 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Jan 10 11:31:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:31:06.046372 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-2249ed6c-3aef-4f41-b719-313a33d20564 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:06.047394 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-2249ed6c-3aef-4f41-b719-313a33d20564 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jan 10 11:31:06.047785 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jan 10 11:31:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:31:06.250570 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-3a64d92e-99a7-4dd7-9962-3b11846df159 admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:06.256053 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.wsgi [None req-3a64d92e-99a7-4dd7-9962-3b11846df159 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 10 11:31:06.256556 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-3a64d92e-99a7-4dd7-9962-3b11846df159 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:31:06.257365 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-3a64d92e-99a7-4dd7-9962-3b11846df159 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066061 Jan 10 11:31:06.257875 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Jan 10 11:31:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:06.267677 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-56ccff1a-8aa4-4413-9b45-10b0dbfc801f admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:06.297626 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-56ccff1a-8aa4-4413-9b45-10b0dbfc801f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033374 Jan 10 11:31:06.298287 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jan 10 11:31:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:31:06.310418 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-8841725d-25c1-45e7-999f-ddfa61a0e06d admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:06.332092 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-8841725d-25c1-45e7-999f-ddfa61a0e06d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026410 Jan 10 11:31:06.332627 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jan 10 11:31:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:31:06.342001 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-068b2c68-065c-41f1-a47a-cb9d93f61d9d admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:06.347527 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.wsgi [None req-068b2c68-065c-41f1-a47a-cb9d93f61d9d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 10 11:31:06.348095 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-068b2c68-065c-41f1-a47a-cb9d93f61d9d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:31:06.348902 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-068b2c68-065c-41f1-a47a-cb9d93f61d9d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010529 Jan 10 11:31:06.349381 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Jan 10 11:31:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:07.914396 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-8841725d-25c1-45e7-999f-ddfa61a0e06d admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:07.915403 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-8841725d-25c1-45e7-999f-ddfa61a0e06d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jan 10 11:31:07.915828 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jan 10 11:31:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:31:08.106090 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-db58c6ba-74ed-495f-b8b1-e703a9b3a5c1 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:08.112098 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.wsgi [None req-db58c6ba-74ed-495f-b8b1-e703a9b3a5c1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 10 11:31:08.112656 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-db58c6ba-74ed-495f-b8b1-e703a9b3a5c1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:31:08.113437 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-db58c6ba-74ed-495f-b8b1-e703a9b3a5c1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058530 Jan 10 11:31:08.113941 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Jan 10 11:31:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:08.123769 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-30fbef82-5efe-4ed5-a6f0-f3450169b6ec admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:08.137265 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-30fbef82-5efe-4ed5-a6f0-f3450169b6ec admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017769 Jan 10 11:31:08.137785 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jan 10 11:31:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:31:08.146914 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-1a3eed37-8c79-45ee-b78a-c8bfa5b02188 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:08.160187 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-1a3eed37-8c79-45ee-b78a-c8bfa5b02188 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016740 Jan 10 11:31:08.160699 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jan 10 11:31:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:31:08.170667 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-37e4627b-198c-4140-ac76-c89a1f098894 admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:08.175864 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.wsgi [None req-37e4627b-198c-4140-ac76-c89a1f098894 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 10 11:31:08.176426 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-37e4627b-198c-4140-ac76-c89a1f098894 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:31:08.177206 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-37e4627b-198c-4140-ac76-c89a1f098894 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011055 Jan 10 11:31:08.177702 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Jan 10 11:31:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:09.747706 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-1a3eed37-8c79-45ee-b78a-c8bfa5b02188 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:09.748895 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-1a3eed37-8c79-45ee-b78a-c8bfa5b02188 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001655 Jan 10 11:31:09.749385 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jan 10 11:31:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:31:09.942579 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-d6c42dff-be8e-474c-95af-666f5d68d40c admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:09.948507 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.wsgi [None req-d6c42dff-be8e-474c-95af-666f5d68d40c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 10 11:31:09.949057 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-d6c42dff-be8e-474c-95af-666f5d68d40c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:31:09.949831 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-d6c42dff-be8e-474c-95af-666f5d68d40c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058951 Jan 10 11:31:09.950361 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jan 10 11:31:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:09.959557 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-66260165-2f31-4c40-b26e-7c04108d8042 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:09.978714 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-66260165-2f31-4c40-b26e-7c04108d8042 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022565 Jan 10 11:31:09.979458 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jan 10 11:31:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:31:09.989652 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-b2cd0e60-725c-4de9-bdf0-56beb2cac93f admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:10.003273 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-b2cd0e60-725c-4de9-bdf0-56beb2cac93f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017839 Jan 10 11:31:10.003805 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Jan 10 11:31:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:31:10.013628 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-5357a48b-fd4c-4776-a467-ba5b2b8445c7 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:10.018860 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.wsgi [None req-5357a48b-fd4c-4776-a467-ba5b2b8445c7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 10 11:31:10.019421 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-5357a48b-fd4c-4776-a467-ba5b2b8445c7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:31:10.020200 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-5357a48b-fd4c-4776-a467-ba5b2b8445c7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010871 Jan 10 11:31:10.020696 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jan 10 11:31:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 10 11:31:11.623218 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-b2cd0e60-725c-4de9-bdf0-56beb2cac93f admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:11.624251 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-b2cd0e60-725c-4de9-bdf0-56beb2cac93f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jan 10 11:31:11.624646 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jan 10 11:31:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:31:11.819339 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-9fe7d3c8-7634-467d-8f28-7f5b3794e7c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:31:11.921552 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-9fe7d3c8-7634-467d-8f28-7f5b3794e7c5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.156216 Jan 10 11:31:11.922108 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Jan 10 11:31:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:31:13.465976 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-b2cd0e60-725c-4de9-bdf0-56beb2cac93f admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:13.466997 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-b2cd0e60-725c-4de9-bdf0-56beb2cac93f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jan 10 11:31:13.467393 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jan 10 11:31:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:31:13.668587 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-f6e6af7f-cca5-4877-b433-385bb29c05ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:31:13.841165 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-f6e6af7f-cca5-4877-b433-385bb29c05ec admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.223121 Jan 10 11:31:13.841705 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Jan 10 11:31:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:31:15.412444 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-b2cd0e60-725c-4de9-bdf0-56beb2cac93f admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:15.413444 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-b2cd0e60-725c-4de9-bdf0-56beb2cac93f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jan 10 11:31:15.413846 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jan 10 11:31:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:31:15.612822 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-f5fb6e86-a252-4bb8-aa39-4976d3ce69d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:31:15.701899 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-f5fb6e86-a252-4bb8-aa39-4976d3ce69d4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.141273 Jan 10 11:31:15.702562 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Jan 10 11:31:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:31:17.303186 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-b2cd0e60-725c-4de9-bdf0-56beb2cac93f admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:17.304188 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-b2cd0e60-725c-4de9-bdf0-56beb2cac93f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jan 10 11:31:17.304584 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jan 10 11:31:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:31:17.497818 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-89aaf73b-3e14-42e8-9da7-94f1605ed0f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:31:17.600376 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-89aaf73b-3e14-42e8-9da7-94f1605ed0f4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.154406 Jan 10 11:31:17.600846 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Jan 10 11:31:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:31:19.139635 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-b2cd0e60-725c-4de9-bdf0-56beb2cac93f admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:19.140630 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-b2cd0e60-725c-4de9-bdf0-56beb2cac93f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jan 10 11:31:19.141026 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jan 10 11:31:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:31:19.341579 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-b93d5c5a-07ab-4633-8fec-2b8cb8d24ab3 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:31:19.360682 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-b93d5c5a-07ab-4633-8fec-2b8cb8d24ab3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074764 Jan 10 11:31:19.361140 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Mon Jan 10 11:31:19 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:32:09.088565 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-b2cd0e60-725c-4de9-bdf0-56beb2cac93f admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:32:09.089568 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-b2cd0e60-725c-4de9-bdf0-56beb2cac93f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jan 10 11:32:09.089969 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 930 bytes} [Mon Jan 10 11:32:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:32:09.150835 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-69e25051-6f76-49c6-b2e1-ee28e0c7b837 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:32:09.171591 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-69e25051-6f76-49c6-b2e1-ee28e0c7b837 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075141 Jan 10 11:32:09.172201 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1291 bytes} [Mon Jan 10 11:32:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:32:09.194895 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-3cf371cb-a71c-4880-92e1-8125658edf62 admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:32:09.202823 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-3cf371cb-a71c-4880-92e1-8125658edf62 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012191 Jan 10 11:32:09.203369 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1282 bytes} [Mon Jan 10 11:32:09 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:32:09.215071 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-61d166b0-a7d0-4ab1-b6ed-7c016a46e49a admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:32:09.222921 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-61d166b0-a7d0-4ab1-b6ed-7c016a46e49a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011372 Jan 10 11:32:09.223454 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1285 bytes} [Mon Jan 10 11:32:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:32:09.235112 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-98fb8daa-205b-48e5-9f78-2263cc043a24 admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:32:09.243646 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-98fb8daa-205b-48e5-9f78-2263cc043a24 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012330 Jan 10 11:32:09.244187 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1285 bytes} [Mon Jan 10 11:32:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:32:09.255637 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-10f1ba74-ad36-418f-80b0-5fd643058995 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:32:09.264298 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-10f1ba74-ad36-418f-80b0-5fd643058995 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012178 Jan 10 11:32:09.274437 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1282 bytes} [Mon Jan 10 11:32:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:33:51.218869 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-c6785f87-856a-49ed-a3f3-3c78e8bb90ee tempest-verify_tempest_config-1448726510 tempest-verify_tempest_config-1448726510-project] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:33:51.220898 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-c6785f87-856a-49ed-a3f3-3c78e8bb90ee tempest-verify_tempest_config-1448726510 tempest-verify_tempest_config-1448726510-project] 10.222.0.20 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106665 Jan 10 11:33:51.221424 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 34/69] 10.222.0.20 () {58 vars in 1133 bytes} [Mon Jan 10 11:33:51 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:35:25.759433 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-10f1ba74-ad36-418f-80b0-5fd643058995 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:35:25.760434 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-10f1ba74-ad36-418f-80b0-5fd643058995 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jan 10 11:35:25.760828 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 36/70] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jan 10 11:35:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:35:26.016937 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-4ef5681b-1e1a-44fe-99e0-6f1b69664499 admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:35:26.018110 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:35:26.018110 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: warnings.warn(msg) Jan 10 11:35:26.019788 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-4ef5681b-1e1a-44fe-99e0-6f1b69664499 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:35:26.020240 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-4ef5681b-1e1a-44fe-99e0-6f1b69664499 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:35:26.021071 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-4ef5681b-1e1a-44fe-99e0-6f1b69664499 admin admin] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:35:26.021487 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-4ef5681b-1e1a-44fe-99e0-6f1b69664499 admin admin] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:35:26.056453 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-4ef5681b-1e1a-44fe-99e0-6f1b69664499 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152150 Jan 10 11:35:26.057205 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 35/71] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jan 10 11:35:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:35:27.655193 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-10f1ba74-ad36-418f-80b0-5fd643058995 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:35:27.657146 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-10f1ba74-ad36-418f-80b0-5fd643058995 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001879 Jan 10 11:35:27.657634 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 37/72] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jan 10 11:35:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:35:27.863452 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-8cc6deb0-c179-4e24-bb37-fabde29da914 admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:35:27.864487 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:35:27.864487 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: warnings.warn(msg) Jan 10 11:35:27.866038 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-8cc6deb0-c179-4e24-bb37-fabde29da914 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:35:27.866516 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-8cc6deb0-c179-4e24-bb37-fabde29da914 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:35:27.867323 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-8cc6deb0-c179-4e24-bb37-fabde29da914 admin admin] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:35:27.867753 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-8cc6deb0-c179-4e24-bb37-fabde29da914 admin admin] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:35:27.894454 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-8cc6deb0-c179-4e24-bb37-fabde29da914 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085236 Jan 10 11:35:27.895019 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 36/73] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jan 10 11:35:27 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:35:39.918725 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-10f1ba74-ad36-418f-80b0-5fd643058995 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:35:39.919715 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-10f1ba74-ad36-418f-80b0-5fd643058995 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jan 10 11:35:39.920171 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 38/74] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jan 10 11:35:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:35:40.121804 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-90fc9089-786c-409a-92c0-9da3ae86ae40 admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:35:40.127395 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:35:40.127395 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: warnings.warn(msg) Jan 10 11:35:40.127395 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-90fc9089-786c-409a-92c0-9da3ae86ae40 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:35:40.127395 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-90fc9089-786c-409a-92c0-9da3ae86ae40 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:35:40.127395 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-90fc9089-786c-409a-92c0-9da3ae86ae40 admin admin] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:35:40.127395 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-90fc9089-786c-409a-92c0-9da3ae86ae40 admin admin] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:35:40.147507 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-90fc9089-786c-409a-92c0-9da3ae86ae40 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077522 Jan 10 11:35:40.148045 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 37/75] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jan 10 11:35:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:35:41.722991 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: DEBUG nova.api.openstack.wsgi [None req-10f1ba74-ad36-418f-80b0-5fd643058995 admin admin] Calling method '>' {{(pid=102592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:35:41.725242 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: INFO nova.api.openstack.requestlog [None req-10f1ba74-ad36-418f-80b0-5fd643058995 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002695 Jan 10 11:35:41.725645 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: [pid: 102592|app: 0|req: 39/76] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Jan 10 11:35:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:35:41.919212 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG nova.api.openstack.wsgi [None req-ed411062-d967-4475-9142-3542144b1865 admin admin] Calling method '>' {{(pid=102593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:35:41.920365 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:35:41.920365 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: warnings.warn(msg) Jan 10 11:35:41.921887 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-ed411062-d967-4475-9142-3542144b1865 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:35:41.922364 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-ed411062-d967-4475-9142-3542144b1865 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:35:41.923256 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-ed411062-d967-4475-9142-3542144b1865 admin admin] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:35:41.923733 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: DEBUG oslo_concurrency.lockutils [None req-ed411062-d967-4475-9142-3542144b1865 admin admin] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:35:41.944553 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: INFO nova.api.openstack.requestlog [None req-ed411062-d967-4475-9142-3542144b1865 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078097 Jan 10 11:35:41.945106 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: [pid: 102593|app: 0|req: 38/77] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Jan 10 11:35:41 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:36:41.238416 dv-cinder-master-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 10 11:36:41.238983 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: Mon Jan 10 11:36:41 2022 - graceful shutdown triggered... Jan 10 11:36:41.239461 dv-cinder-master-3-iscsi devstack@n-api.service[102592]: Gracefully killing worker 1 (pid: 102592)... Jan 10 11:36:41.240232 dv-cinder-master-3-iscsi devstack@n-api.service[102593]: Gracefully killing worker 2 (pid: 102593)... Jan 10 11:36:42.240155 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: worker 1 buried after 1 seconds Jan 10 11:36:42.240155 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: worker 2 buried after 1 seconds Jan 10 11:36:42.240155 dv-cinder-master-3-iscsi devstack@n-api.service[102591]: goodbye to uWSGI. Jan 10 11:36:42.242809 dv-cinder-master-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 10 11:36:42.243383 dv-cinder-master-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 10 11:36:42.246384 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 10 11:36:42.261769 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 10 11:36:42.264824 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 10 11:36:42 2022] *** Jan 10 11:36:42.264824 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 10 11:36:42.264824 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 10 11:36:42.264824 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: nodename: dv-cinder-master-3-iscsi Jan 10 11:36:42.264824 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: machine: x86_64 Jan 10 11:36:42.264824 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: clock source: unix Jan 10 11:36:42.264824 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: pcre jit disabled Jan 10 11:36:42.264824 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: detected number of CPU cores: 4 Jan 10 11:36:42.264824 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: current working directory: / Jan 10 11:36:42.264824 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: detected binary path: /usr/bin/uwsgi-core Jan 10 11:36:42.264824 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: your processes number limit is 47680 Jan 10 11:36:42.264824 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: your memory page size is 4096 bytes Jan 10 11:36:42.264824 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: detected max file descriptor number: 2048 Jan 10 11:36:42.264824 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: lock engine: pthread robust mutexes Jan 10 11:36:42.265985 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: thunder lock: enabled Jan 10 11:36:42.265985 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 10 11:36:42.265985 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 10 11:36:42.318094 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: Python main interpreter initialized at 0x55d45b31f9c0 Jan 10 11:36:42.318094 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: python threads support enabled Jan 10 11:36:42.318094 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: your server socket listen backlog is limited to 100 connections Jan 10 11:36:42.318094 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: your mercy for graceful operations on workers is 90 seconds Jan 10 11:36:42.318582 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: mapped 403077 bytes (393 KB) for 2 cores Jan 10 11:36:42.318582 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: *** Operational MODE: preforking *** Jan 10 11:36:42.319642 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: *** uWSGI is running in multiple interpreter mode *** Jan 10 11:36:42.319642 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: spawned uWSGI master process (pid: 128706) Jan 10 11:36:42.319854 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 10 11:36:42.320469 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: spawned uWSGI worker 1 (pid: 128718, cores: 1) Jan 10 11:36:42.320838 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: spawned uWSGI worker 2 (pid: 128719, cores: 1) Jan 10 11:36:42.321007 dv-cinder-master-3-iscsi devstack@n-api.service[128706]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 10 11:36:44.336271 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 11:36:44.336271 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: from cryptography.utils import int_from_bytes Jan 10 11:36:44.337008 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 11:36:44.337008 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: from cryptography.utils import int_from_bytes Jan 10 11:36:44.348057 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 11:36:44.348057 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: from cryptography.utils import int_from_bytes Jan 10 11:36:44.349208 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 11:36:44.349208 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: from cryptography.utils import int_from_bytes Jan 10 11:36:46.885747 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 10 11:36:46.886428 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 10 11:36:46.886519 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 10 11:36:46.886820 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 10 11:36:46.887093 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 10 11:36:46.887499 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.887840 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.888180 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.888515 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.888863 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.889175 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.889516 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.889879 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.890204 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.890522 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.890821 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.891158 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.891495 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.891818 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.892144 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.892479 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.892799 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.893159 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.893464 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.893980 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.895745 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.895745 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.895745 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.895745 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.895745 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.896422 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.896422 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.896955 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.897431 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.897775 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.898178 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.898574 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.898868 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.899193 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.899642 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.899978 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.900286 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.900620 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.900961 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.901280 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.901624 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.901959 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.902322 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.902732 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.903150 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.903479 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.903689 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.903876 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.904200 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.904522 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.904788 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.905113 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.905451 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.905791 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.906128 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.906421 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.906677 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.907010 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.907351 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.907674 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.907995 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.908320 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.908641 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.908953 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.909272 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.909592 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.909903 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.910278 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.910597 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.910955 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.911253 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.911585 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.912012 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.912275 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.913146 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.913507 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.913837 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.914162 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.914517 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.915033 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.915283 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.915474 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.915841 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.916099 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.916547 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.916776 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.917008 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.917492 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.917726 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.917955 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.918393 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.918588 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.919039 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.919230 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.920321 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.920321 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.920321 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.920800 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.920800 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.921093 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.921338 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.921660 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.921975 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.922335 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.922667 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.924229 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.924229 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.924229 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.924229 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.924229 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.925720 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.925720 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.925720 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.925720 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.926390 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.926390 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.926390 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.926914 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.927075 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.929556 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.929556 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.929556 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.929556 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.929556 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.929556 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.930951 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.930951 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.930951 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.930951 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.931708 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.931708 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.932032 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.932251 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.932488 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.932761 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.933078 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.933414 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.933773 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.934123 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.934507 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.934840 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.935186 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.935530 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.935862 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.936189 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.936518 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.936863 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.937191 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.937584 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.937861 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.938650 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.938650 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.939107 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.939342 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.939511 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.939772 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.940095 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.940424 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.940763 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.941099 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.941424 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.941781 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.942137 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.942494 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.942838 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.943149 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.943519 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.943858 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.944425 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.944666 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.945013 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.945345 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.945670 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.946019 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.946377 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.946708 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.947028 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.947347 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.947666 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.947987 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.948300 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.949590 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.949590 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.949590 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.949590 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.950313 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.950313 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.950599 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.950868 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.951187 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.951515 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.951835 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.952173 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.952490 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.952824 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.953165 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.953456 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.953777 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.954103 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.954726 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.954912 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.955082 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.955418 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.956052 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.956393 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.956725 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.957069 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.957390 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.957731 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.958068 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.958421 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.958739 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.959069 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.959427 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.959737 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.960233 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.960558 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.960878 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.961200 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.961518 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.961835 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.962153 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.962958 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.963820 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.963820 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.963995 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.964207 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.964568 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.964893 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.965251 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.965604 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.965972 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.966370 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.966704 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.967037 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.968071 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 10 11:36:46.969338 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.969683 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 10 11:36:46.969841 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.969841 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.970132 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 10 11:36:46.970308 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.970475 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 10 11:36:46.970642 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.970803 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 10 11:36:46.970960 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.971182 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.971475 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.971631 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.971783 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.971934 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.972076 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.972225 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.972384 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.972539 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.972689 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.972856 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.973000 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.973144 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.973299 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.973453 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.973648 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.973799 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.973799 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.974079 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.974254 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.974414 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.974566 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.974566 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.975489 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.976028 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.976181 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.976333 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.976528 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.976778 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.977165 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.977405 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.977713 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.977870 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.978021 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.978268 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.978431 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.978585 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.978585 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.978908 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.979060 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.979474 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.979655 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.979851 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.979997 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.980147 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.980292 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.980455 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.980613 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.980757 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.980904 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.981047 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.981188 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.981330 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.981485 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.981689 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.981914 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.982145 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.982403 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.982702 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.982910 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.983080 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.983225 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.983439 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.983668 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.983914 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.983914 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.984229 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.984450 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.984601 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.984814 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.985047 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.985268 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.985492 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.985688 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.986304 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.986534 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.986759 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.986759 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.986759 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.987344 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.987344 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.987722 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.988129 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.988333 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.988499 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.988689 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.988913 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.989154 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.989373 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.989592 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.989751 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.989957 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.990107 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.990285 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.990474 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.991267 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.991267 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.991713 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.991919 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.992077 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.992485 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.992651 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.992797 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.992955 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.993103 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.993259 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.993411 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.993555 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.993697 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.993937 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.994171 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.994369 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.994536 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.994689 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.994858 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.995044 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.995288 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.995522 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.995817 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.995989 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.996618 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.996866 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.997098 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.997268 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.997556 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.997722 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.997945 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.998370 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.998532 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.998532 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.998836 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.999059 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.999288 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.999521 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:46.999750 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:46.999980 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.000184 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.000332 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.000332 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.000332 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.001133 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.001133 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.001412 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.001564 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.001707 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.001893 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.002069 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.002258 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.002420 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.002565 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.002722 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.002897 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.003074 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.003302 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.003506 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.003673 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.003851 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.003851 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.004154 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.004297 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.004451 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.004451 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.004740 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.004883 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.005048 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.005048 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.005380 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.005523 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.005523 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.005882 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.006032 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.006204 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.006825 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.006997 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.007149 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.007321 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.007559 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.007821 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.008035 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.008279 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.008700 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.008932 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.009168 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.009396 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.009621 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.009877 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.010116 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.010389 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.010620 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.010849 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.011076 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.011076 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.011517 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.011737 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.011970 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.012157 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.012395 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.012692 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.012871 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.013020 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.013020 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.013306 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.013459 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.013603 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.014404 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.014577 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.014731 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.014898 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.015059 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.015214 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.015363 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.015512 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.015897 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.016065 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.016246 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.016495 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.016833 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.017140 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.017291 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.017291 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.017569 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.017713 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.017998 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.018165 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.018347 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.018502 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.018671 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.019027 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.019199 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.019345 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.019487 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.019629 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.019771 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.019924 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.020127 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.020337 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.020485 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.020627 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.020627 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.021137 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.021389 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.021611 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.021872 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.022101 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.022404 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.022682 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.023039 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.023231 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.023388 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.023533 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.023676 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.023833 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.023977 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.023977 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.024401 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.024634 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.024863 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.025093 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.025315 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.025315 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.025623 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 11:36:47.025623 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.025920 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.026075 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.026243 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.026395 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.026551 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.026698 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.027134 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.027596 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.027819 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.028510 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.028669 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.028830 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.029031 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.029187 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.029333 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.029481 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.029621 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.029768 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.029927 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.030078 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.030284 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.030421 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.030560 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.030706 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.030842 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.030950 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.031073 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.031241 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.031330 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.031429 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.031578 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.031726 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.031864 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.032010 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.032148 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.032294 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.032431 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.032573 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.032735 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.032865 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.033031 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.033191 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.033335 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.033494 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.033651 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.033811 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.033969 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.034115 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.034288 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.034427 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.034562 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.034562 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.034942 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.034942 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.035227 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.035386 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.035538 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.035684 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.035851 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.035995 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.036131 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.036266 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.036266 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.036497 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.036652 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.036810 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.036950 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.037114 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.037265 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.037988 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.038139 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.038543 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.038696 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.038847 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.038988 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.039150 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.039292 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.039435 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.039571 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.039727 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.039885 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.040046 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.040196 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.040343 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.040502 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.040651 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.040792 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.040957 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.041102 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.041259 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.041427 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.041569 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.041569 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.041840 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.041840 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.041840 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.041840 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.041840 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.042541 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.042700 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.042859 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.043025 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.043158 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.043325 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.043487 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.043636 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.043782 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.043933 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.043933 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.044179 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.044281 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.044367 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.044458 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.044558 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.044643 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.044738 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.044846 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.044942 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.045034 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.045121 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.045212 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.045212 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.045382 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.045466 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.045550 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.045634 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.045725 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.045820 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.045916 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.046000 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.046083 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.046171 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.046315 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.046405 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.046501 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.046594 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.046679 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.046763 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.046904 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.046996 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.047081 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.047164 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.047275 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.047431 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.047591 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.047734 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.047875 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.048016 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.048148 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.048287 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.048413 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.048671 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.048771 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.048857 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.048941 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.049033 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.049128 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.049214 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.049304 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.049388 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.049471 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.049562 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.049648 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.049731 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.049823 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.049915 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.049999 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.050096 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.050189 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.050301 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.050301 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.050456 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.050546 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.050640 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.050726 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.050839 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.050933 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.051060 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.051060 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.051243 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.051243 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.051413 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.051506 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.051590 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.051688 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.051781 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.051865 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.051948 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.052038 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.052122 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.052214 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.052299 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.052381 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.052381 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.052664 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.052762 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.052846 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.052938 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.053203 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.053860 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.053939 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.054020 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.054108 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.054181 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.054285 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.054372 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.054452 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.054539 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.054613 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.054724 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.054828 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.054929 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.055005 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.055087 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.055168 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.055240 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.055318 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.055403 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.055482 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.055568 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.055647 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.055725 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.055796 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.055866 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.055943 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.056028 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.056100 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.056178 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.056249 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.056329 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.056407 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.056495 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.056568 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.056650 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.056722 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.056797 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.057023 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.057114 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.057216 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.057335 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.057467 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.057467 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.057467 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.057832 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.057970 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.058100 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.058267 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.058416 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.058562 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.058713 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.058860 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.059003 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.059131 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.059256 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.059418 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.059547 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.059672 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.059792 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.059924 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.060063 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.060196 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.060324 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.060446 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.060570 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.060570 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.060570 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.060570 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.060570 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.060981 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.061063 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.061159 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.061263 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.061410 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.061543 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.061693 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.061831 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.061967 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.062117 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.062117 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.062466 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.062542 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.062627 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.062714 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.062807 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.062919 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.062997 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.063068 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.063208 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.063325 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.063736 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.063889 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.064042 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.064248 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.064384 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.064552 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.064654 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.064748 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.064868 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.065075 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.065196 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.065440 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.065594 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.065770 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.065917 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.066096 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.066205 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.066444 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.066536 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.066769 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.066874 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.067097 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.067208 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.067408 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.067499 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.067729 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.067831 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.068052 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.068251 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.068400 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.068547 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.068731 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.068874 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.069137 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.069245 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.069458 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.069551 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.069798 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.069957 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.070119 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.070407 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.070505 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.070610 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.070936 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.071105 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.071268 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.071411 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.071558 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.071689 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.071840 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.071988 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.072149 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.072300 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.072469 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.072601 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.072733 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.072884 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.072989 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.073125 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.073233 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.073470 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.073629 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.073812 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.073945 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.074231 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.074482 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.074609 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.074829 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.074946 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.075156 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.075338 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.075493 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.075607 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.075824 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.075929 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.076152 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.076248 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.076476 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.076568 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.076794 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.076896 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.077117 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.077218 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.077430 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.077523 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.077747 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.077829 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.078058 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.078145 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.078506 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.078620 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.078716 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.078815 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.079018 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.079126 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.079331 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.079434 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.079640 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.079730 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.079960 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.080060 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.080271 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.080355 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.080602 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.080720 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.080907 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.081001 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.081224 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.081325 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.081539 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.081631 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.081850 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.081944 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.082705 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.082817 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.082891 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.082992 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.083080 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.083162 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.083241 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.083312 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.083436 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.083560 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.083748 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.083886 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.084060 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.084225 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.084488 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.084587 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.084752 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.084915 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.085244 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.085342 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.085573 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.085673 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.085903 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.085996 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.086246 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.086360 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.086572 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.086664 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.086894 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.086992 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.087205 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.087313 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.087516 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.087617 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.087829 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.087930 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.088148 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.088422 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.088513 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.088764 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.088856 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.089086 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.089185 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.089404 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.089508 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.089723 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.089815 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.090041 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.090132 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.090379 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.090479 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.090714 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.090845 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.091015 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.091124 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.091335 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.091486 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.091655 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.091806 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.091969 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.092135 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.092284 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.092433 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.092603 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.092698 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.092921 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.093061 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.093234 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.093385 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.093551 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.093691 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.093862 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.094001 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.094186 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.094311 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.094523 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.094628 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.094836 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.094936 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.095146 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.095240 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.095467 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.095568 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.095783 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.095884 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.096093 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.096185 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.096424 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.096524 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.096743 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.096845 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.097054 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.097145 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.097375 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.097491 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.097690 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.097818 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.098000 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.098107 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.098335 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.098443 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.098655 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.098784 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.098987 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.099092 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.099310 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.099423 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.099622 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.099795 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.100687 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.100842 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.100975 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.101152 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.101306 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.101475 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.101619 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.101759 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.101910 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.102095 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.102363 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.102534 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.102735 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.102871 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.103028 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.103253 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.103410 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.103568 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.103723 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.103881 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.104064 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.104449 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.104641 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.104821 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.104992 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.105149 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.105316 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.105490 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.105649 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.105805 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.105963 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.106155 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.106371 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.106521 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.106652 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.106792 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.106921 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.107145 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.107285 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.107416 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.107546 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.107688 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.107817 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.107958 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.108097 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.108236 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.108364 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.108498 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.108629 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.108773 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.108945 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.109076 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.109266 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.109397 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.109578 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.109718 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.109887 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.110032 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.110288 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.110439 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.110584 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.110720 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.110903 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.111081 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.111226 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.111361 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.111599 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.111757 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.111891 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.112024 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.112152 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.112283 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.112511 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.112663 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.112800 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.112930 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.113081 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.113214 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.113358 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.113494 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.113667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.113808 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.113985 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.114128 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.114339 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.114472 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.114661 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.114827 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.114979 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.115132 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.115262 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.115390 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.115627 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.116253 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.116451 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.116594 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.116766 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.116907 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.117080 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.117210 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.117405 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.117548 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.117723 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.117864 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.118042 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.118182 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.118378 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.118514 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.118692 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.118841 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.119006 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.119160 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.119326 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.119460 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.119645 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.119880 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.120016 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.120205 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.120373 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.120523 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.120652 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.120825 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.120968 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.121148 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.121309 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.121464 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.121596 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.121829 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.121975 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.122122 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.122295 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.122460 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.122598 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.122861 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.122999 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.123193 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.123441 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.123583 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.123803 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.123945 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.124112 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.124263 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.124426 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.124567 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.124748 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.124900 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.125079 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.125231 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.125372 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.125528 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.125684 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.125827 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.125984 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.126113 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.126336 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.126471 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.126651 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.126822 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.126971 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.127116 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.127310 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.127460 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.127673 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.127814 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.127958 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.128098 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.128247 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.128393 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.128567 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.128718 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.128886 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.129022 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.129213 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.129345 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.129567 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.129709 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.129906 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.130039 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.130258 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.130401 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.130589 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.130727 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.130904 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.131025 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.131273 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.131577 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.131705 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.131981 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.132152 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.132279 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.132407 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.132602 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.132779 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.132908 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.133028 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.133139 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.133249 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.133795 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.133920 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.133920 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.134128 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.134267 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.134400 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.134532 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.134648 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.134852 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.135060 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.135258 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.135402 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.135551 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.135681 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.135864 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.136003 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.136134 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.136274 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.136420 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.136603 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.136742 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.136902 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.137058 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.137199 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.137387 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.137519 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.137721 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.137869 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.138037 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.138202 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.138385 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.138517 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.138684 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.138826 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.138997 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.139139 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.139304 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.139434 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.139616 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.139747 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.139945 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.140161 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.140291 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.140422 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.140562 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.140702 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.140877 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.141011 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.141207 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.141337 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.141546 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.141672 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.141858 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.142040 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.142193 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.142367 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.142498 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.142643 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.142811 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.142944 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.143125 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.143267 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.143435 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.143613 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.144105 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.144242 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.144375 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.144506 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.144647 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.144795 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.144795 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.145041 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.145199 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.145414 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.145557 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.145699 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.145846 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.145986 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.146119 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.146281 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.146413 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.146564 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.146701 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.146831 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.147101 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.147259 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.147391 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.147610 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.147751 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.147893 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.148027 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.148166 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.148309 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.148463 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.148593 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.148725 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.148900 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.149034 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.149227 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.149360 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.149558 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.149705 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.149893 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.150033 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.150245 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.150386 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.150580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.150726 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.150894 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.151038 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.151224 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.151357 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.151541 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.151685 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.151859 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.152020 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.152160 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.152299 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.152466 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.152611 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.152819 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.152962 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.153133 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.153275 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.153487 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.153632 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.153773 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 10 11:36:47.154014 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.154596 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.154596 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.154856 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.155132 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.155461 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.155784 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.156108 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.156433 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.156765 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.157090 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.157418 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.157737 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.158061 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.158411 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.158739 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.159316 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.159654 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.159979 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.160302 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.160624 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.160944 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.161266 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.161588 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.161916 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.162262 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.163261 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.163487 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.163835 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.164221 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.164583 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.164901 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.165227 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.165555 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.165881 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.166274 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.166606 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.166926 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.167251 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.167579 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.167904 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.168225 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.168545 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.168870 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.169196 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.169517 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.169835 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.170159 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.171253 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.171253 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.171253 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.171610 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.171846 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.172170 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.172498 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.173207 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.173777 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.174259 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.174259 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.174737 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.174908 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.175133 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.175509 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.175828 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.176143 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.176469 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.176784 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.177108 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.177440 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.177773 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.178133 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.178991 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.179311 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.179694 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_db.sqlalchemy.engines [None req-cb583b75-07d6-43e9-afc4-b5d64fd1ec08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:36:47.179886 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.180237 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.180565 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.180898 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.181229 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.181553 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.181863 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.182395 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.182598 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.182913 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.183241 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.183563 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.183873 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.184184 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.184504 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.184818 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.185134 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.185452 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.185761 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.186098 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.186440 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.186754 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.187072 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.187394 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.187709 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.188021 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.188334 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.188717 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.189040 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.189353 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.189672 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.189985 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.190328 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.190643 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.190969 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.191280 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.191615 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.191934 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.192249 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.192580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.192898 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.193230 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.193555 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.194282 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.194564 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.194849 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.195383 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.195779 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.196109 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.196470 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.196821 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.197143 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.197461 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.197787 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.198117 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.198464 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.198787 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.199108 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.199531 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.199783 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.200096 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.200417 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.200733 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.201052 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.201376 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.201731 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.202058 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.202412 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.202806 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.203198 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.203453 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.203702 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.203990 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.204309 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.204631 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.204968 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.205286 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.205710 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.206024 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.206377 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.217172 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.217172 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.217172 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.217172 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.217172 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.217172 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.217172 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.217172 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.217948 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.217948 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.217948 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.217948 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.217948 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.217948 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.217948 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.217948 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.218580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.218580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.218580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.218580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.218580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.218580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.218580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.218580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.219236 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.219236 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.219236 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.219236 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.219236 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.219236 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.219236 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.219236 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.219848 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.219848 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.219848 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.219848 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.219848 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.219848 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.219848 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.219848 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.220436 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.220436 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.220436 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.220668 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.220817 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.221139 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.221462 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.221790 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.222113 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.222520 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.222858 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.223195 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.223510 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.223879 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.224203 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.224562 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.225444 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.226031 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.226342 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.226667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 11:36:47.226906 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 10 11:36:47.251460 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_db.sqlalchemy.engines [None req-6db93df7-17da-4249-9a5f-57d74e151cdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128718) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:36:47.259896 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.context [None req-cb583b75-07d6-43e9-afc4-b5d64fd1ec08 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b04a23e9-a80a-461f-a3e7-7cc1d42b02ad(cell1) {{(pid=128719) load_cells /opt/stack/nova/nova/context.py:464}} Jan 10 11:36:47.264536 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cb583b75-07d6-43e9-afc4-b5d64fd1ec08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:36:47.266177 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cb583b75-07d6-43e9-afc4-b5d64fd1ec08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:36:47.267063 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cb583b75-07d6-43e9-afc4-b5d64fd1ec08 None None] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:36:47.269079 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cb583b75-07d6-43e9-afc4-b5d64fd1ec08 None None] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:36:47.282475 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_db.sqlalchemy.engines [None req-cb583b75-07d6-43e9-afc4-b5d64fd1ec08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:36:47.290729 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_db.sqlalchemy.engines [None req-cb583b75-07d6-43e9-afc4-b5d64fd1ec08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:36:47.342381 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.context [None req-6db93df7-17da-4249-9a5f-57d74e151cdb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b04a23e9-a80a-461f-a3e7-7cc1d42b02ad(cell1) {{(pid=128718) load_cells /opt/stack/nova/nova/context.py:464}} Jan 10 11:36:47.351274 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6db93df7-17da-4249-9a5f-57d74e151cdb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:36:47.353027 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6db93df7-17da-4249-9a5f-57d74e151cdb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:36:47.353883 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6db93df7-17da-4249-9a5f-57d74e151cdb None None] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:36:47.356158 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6db93df7-17da-4249-9a5f-57d74e151cdb None None] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:36:47.369165 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_db.sqlalchemy.engines [None req-6db93df7-17da-4249-9a5f-57d74e151cdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128718) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:36:47.370337 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_db.sqlalchemy.engines [None req-6db93df7-17da-4249-9a5f-57d74e151cdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128718) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:36:47.472600 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_db.sqlalchemy.engines [None req-cb583b75-07d6-43e9-afc4-b5d64fd1ec08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:36:47.547685 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_db.sqlalchemy.engines [None req-6db93df7-17da-4249-9a5f-57d74e151cdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128718) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 11:36:47.905399 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: WARNING keystonemiddleware.auth_token [None req-6db93df7-17da-4249-9a5f-57d74e151cdb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 10 11:36:47.905399 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: WARNING keystonemiddleware.auth_token [None req-6db93df7-17da-4249-9a5f-57d74e151cdb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 10 11:36:47.950893 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: WARNING keystonemiddleware.auth_token [None req-cb583b75-07d6-43e9-afc4-b5d64fd1ec08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 10 11:36:47.958050 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: WARNING keystonemiddleware.auth_token [None req-cb583b75-07d6-43e9-afc4-b5d64fd1ec08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 10 11:36:48.254688 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: WARNING keystonemiddleware.auth_token [None req-6db93df7-17da-4249-9a5f-57d74e151cdb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 10 11:36:48.260773 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: WARNING keystonemiddleware.auth_token [None req-6db93df7-17da-4249-9a5f-57d74e151cdb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 10 11:36:48.266809 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d45b31f9c0 pid: 128718 (default app) Jan 10 11:36:48.316465 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: WARNING keystonemiddleware.auth_token [None req-cb583b75-07d6-43e9-afc4-b5d64fd1ec08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 10 11:36:48.322790 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: WARNING keystonemiddleware.auth_token [None req-cb583b75-07d6-43e9-afc4-b5d64fd1ec08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 10 11:36:48.328325 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d45b31f9c0 pid: 128719 (default app) Jan 10 11:37:27.124356 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-9af6c2e7-b2cf-49c7-9b2e-2f2a50d2f269 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-277053684", "imageRef": "b6e63192-9c33-4d80-9555-6de2bb10fd32", "flavorRef": "452", "networks": [{"uuid": "73452465-d5d7-4c27-928c-80c648c05035"}]}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:37:28.376248 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.network.neutron [None req-9af6c2e7-b2cf-49c7-9b2e-2f2a50d2f269 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] validate_networks() for [('73452465-d5d7-4c27-928c-80c648c05035', None, None, None, None, None)] {{(pid=128718) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:37:28.746124 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-68a46938-347d-435d-9cf2-c98405ce7679 tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] Action: 'create', calling method: .version_select at 0x7f477b901a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-983986028", "metadata": {"Type": "work"}}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:37:30.380807 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-9af6c2e7-b2cf-49c7-9b2e-2f2a50d2f269 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Flavor limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:37:30.384174 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-9af6c2e7-b2cf-49c7-9b2e-2f2a50d2f269 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Image limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:37:30.385632 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-9af6c2e7-b2cf-49c7-9b2e-2f2a50d2f269 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Flavor pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:37:30.387880 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-9af6c2e7-b2cf-49c7-9b2e-2f2a50d2f269 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Image pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:37:30.388887 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-9af6c2e7-b2cf-49c7-9b2e-2f2a50d2f269 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:37:30.420983 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9af6c2e7-b2cf-49c7-9b2e-2f2a50d2f269 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:30.422017 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9af6c2e7-b2cf-49c7-9b2e-2f2a50d2f269 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:30.426531 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9af6c2e7-b2cf-49c7-9b2e-2f2a50d2f269 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:30.429689 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9af6c2e7-b2cf-49c7-9b2e-2f2a50d2f269 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:30.531494 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-9af6c2e7-b2cf-49c7-9b2e-2f2a50d2f269 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Getting quotas for project 1c300abbfb3b48dab6c40f20c7eb9cd1. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:37:30.546561 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-9af6c2e7-b2cf-49c7-9b2e-2f2a50d2f269 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Getting quotas for user b6431c85b6c74608aae42e0e856d1a6d and project 1c300abbfb3b48dab6c40f20c7eb9cd1. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:37:30.610623 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-9af6c2e7-b2cf-49c7-9b2e-2f2a50d2f269 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Going to run 1 instances... {{(pid=128718) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:37:30.619260 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-9af6c2e7-b2cf-49c7-9b2e-2f2a50d2f269 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e63192-9c33-4d80-9555-6de2bb10fd32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:37:30.866630 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-9af6c2e7-b2cf-49c7-9b2e-2f2a50d2f269 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.826449 Jan 10 11:37:30.867791 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:37:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 5830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 11:37:30.880862 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a8f82d58-e0eb-4f0b-a9f2-8e0092349eab tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:30.881530 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a8f82d58-e0eb-4f0b-a9f2-8e0092349eab tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:30.901620 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-68a46938-347d-435d-9cf2-c98405ce7679 tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.060226 Jan 10 11:37:30.903532 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 1/2] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jan 10 11:37:26 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4065 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 10 11:37:30.922887 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b1797d4b-9dd2-4b87-91dc-abb86acbd112 tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] Calling method '.version_select at 0x7f477b7cc5e0>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:31.024998 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b1797d4b-9dd2-4b87-91dc-abb86acbd112 tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/35c847e0-6f0a-4662-bbc2-1b0985449fd6" status: 200 len: 352 microversion: 2.1 time: 0.106025 Jan 10 11:37:31.026416 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jan 10 11:37:30 2022] GET /compute/v2.1/os-volumes/35c847e0-6f0a-4662-bbc2-1b0985449fd6 => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:37:31.169244 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-a8f82d58-e0eb-4f0b-a9f2-8e0092349eab tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:31.172996 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a8f82d58-e0eb-4f0b-a9f2-8e0092349eab tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1217 microversion: 2.1 time: 0.298544 Jan 10 11:37:31.174882 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:30 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1217 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:37:31.317265 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-8eead612-e64d-46d8-80f8-69b20d7b7e23 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1423338524", "imageRef": "b6e63192-9c33-4d80-9555-6de2bb10fd32", "flavorRef": "452", "networks": [{"uuid": "e4972d56-4582-4fa2-b636-32f4939795bb"}]}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:37:31.523808 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.network.neutron [None req-8eead612-e64d-46d8-80f8-69b20d7b7e23 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] validate_networks() for [('e4972d56-4582-4fa2-b636-32f4939795bb', None, None, None, None, None)] {{(pid=128719) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:37:32.054522 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-24ad222e-9d9b-4309-ae50-98d5c8deaee8 tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] Calling method '.version_select at 0x7f477aefb8b0>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:32.222345 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-24ad222e-9d9b-4309-ae50-98d5c8deaee8 tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/35c847e0-6f0a-4662-bbc2-1b0985449fd6" status: 200 len: 352 microversion: 2.1 time: 0.175077 Jan 10 11:37:32.223268 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jan 10 11:37:32 2022] GET /compute/v2.1/os-volumes/35c847e0-6f0a-4662-bbc2-1b0985449fd6 => generated 352 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:37:32.229869 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-109801e9-a065-4059-a676-666c5c6e08d1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:32.234653 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-109801e9-a065-4059-a676-666c5c6e08d1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:32.363837 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-109801e9-a065-4059-a676-666c5c6e08d1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:32.379636 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-109801e9-a065-4059-a676-666c5c6e08d1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1217 microversion: 2.1 time: 0.155061 Jan 10 11:37:32.380590 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 4/6] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:32 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:32.533622 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-8eead612-e64d-46d8-80f8-69b20d7b7e23 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Flavor limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:37:32.533622 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-8eead612-e64d-46d8-80f8-69b20d7b7e23 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Image limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:37:32.533622 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-8eead612-e64d-46d8-80f8-69b20d7b7e23 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Flavor pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:37:32.533622 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-8eead612-e64d-46d8-80f8-69b20d7b7e23 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Image pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:37:32.534814 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-8eead612-e64d-46d8-80f8-69b20d7b7e23 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:37:32.596454 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8eead612-e64d-46d8-80f8-69b20d7b7e23 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:32.596912 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8eead612-e64d-46d8-80f8-69b20d7b7e23 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:32.597754 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8eead612-e64d-46d8-80f8-69b20d7b7e23 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:32.598199 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8eead612-e64d-46d8-80f8-69b20d7b7e23 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:32.706796 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-8eead612-e64d-46d8-80f8-69b20d7b7e23 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Getting quotas for project dd16126432b64642b65fa0a3d8bd7043. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:37:32.730493 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-8eead612-e64d-46d8-80f8-69b20d7b7e23 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Getting quotas for user 8fa7971d6f99464bbe62c60e318cf414 and project dd16126432b64642b65fa0a3d8bd7043. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:37:32.763227 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-8eead612-e64d-46d8-80f8-69b20d7b7e23 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Going to run 1 instances... {{(pid=128719) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:37:32.771885 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-8eead612-e64d-46d8-80f8-69b20d7b7e23 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e63192-9c33-4d80-9555-6de2bb10fd32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:37:33.163287 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-8eead612-e64d-46d8-80f8-69b20d7b7e23 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.954065 Jan 10 11:37:33.163973 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 3/7] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:37:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 11:37:33.178698 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-fc464489-4b54-4683-876b-38582eb7f2ab tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:33.180117 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-fc464489-4b54-4683-876b-38582eb7f2ab tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:33.297574 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b2afe9bf-e0b2-49f9-8812-83173bdea559 tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] Calling method '.version_select at 0x7f477b6ddd30>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:33.417070 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-fc464489-4b54-4683-876b-38582eb7f2ab tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:33.429113 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-fc464489-4b54-4683-876b-38582eb7f2ab tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1215 microversion: 2.1 time: 0.254696 Jan 10 11:37:33.438870 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:33 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1215 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:37:33.438870 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7280dd41-c7e0-4e7c-83d3-384ec877a878 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:33.438870 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7280dd41-c7e0-4e7c-83d3-384ec877a878 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:33.469008 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b2afe9bf-e0b2-49f9-8812-83173bdea559 tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/35c847e0-6f0a-4662-bbc2-1b0985449fd6" status: 200 len: 353 microversion: 2.1 time: 0.175720 Jan 10 11:37:33.470044 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 4/9] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jan 10 11:37:33 2022] GET /compute/v2.1/os-volumes/35c847e0-6f0a-4662-bbc2-1b0985449fd6 => generated 353 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:37:33.485257 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-14e4430d-4117-440f-865c-4709ecf31964 tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] Calling method '.version_select at 0x7f477b6dddc0>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:33.559280 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7280dd41-c7e0-4e7c-83d3-384ec877a878 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:33.582626 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7280dd41-c7e0-4e7c-83d3-384ec877a878 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1217 microversion: 2.1 time: 0.149794 Jan 10 11:37:33.582626 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 6/10] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:33 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:33.634745 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-14e4430d-4117-440f-865c-4709ecf31964 tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/35c847e0-6f0a-4662-bbc2-1b0985449fd6" status: 200 len: 353 microversion: 2.1 time: 0.155665 Jan 10 11:37:33.636304 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 5/11] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jan 10 11:37:33 2022] GET /compute/v2.1/os-volumes/35c847e0-6f0a-4662-bbc2-1b0985449fd6 => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:37:33.653745 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c95fef6f-f161-4485-aa56-e1595cc84412 tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] Calling method '.version_select at 0x7f477a6a6dc0>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:34.141500 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c95fef6f-f161-4485-aa56-e1595cc84412 tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/35c847e0-6f0a-4662-bbc2-1b0985449fd6" status: 202 len: 0 microversion: 2.1 time: 0.491567 Jan 10 11:37:34.142600 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jan 10 11:37:33 2022] DELETE /compute/v2.1/os-volumes/35c847e0-6f0a-4662-bbc2-1b0985449fd6 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:37:34.174911 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-de938669-a147-47a9-bc65-781b611eae08 tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] Calling method '.version_select at 0x7f477a679670>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:34.292272 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-de938669-a147-47a9-bc65-781b611eae08 tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/35c847e0-6f0a-4662-bbc2-1b0985449fd6" status: 200 len: 352 microversion: 2.1 time: 0.142042 Jan 10 11:37:34.294701 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jan 10 11:37:34 2022] GET /compute/v2.1/os-volumes/35c847e0-6f0a-4662-bbc2-1b0985449fd6 => generated 352 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:37:34.448233 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-5c0e01ef-ce3e-4aee-a573-4dcd542c3718 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:34.448233 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-5c0e01ef-ce3e-4aee-a573-4dcd542c3718 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:34.605473 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5cb1f967-1b64-497d-800e-781f0467441e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:34.614598 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5cb1f967-1b64-497d-800e-781f0467441e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:34.696941 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-5c0e01ef-ce3e-4aee-a573-4dcd542c3718 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:34.698808 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5cb1f967-1b64-497d-800e-781f0467441e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:34.700887 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5cb1f967-1b64-497d-800e-781f0467441e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:34.703387 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5cb1f967-1b64-497d-800e-781f0467441e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:34.705286 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-5c0e01ef-ce3e-4aee-a573-4dcd542c3718 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1215 microversion: 2.1 time: 0.262222 Jan 10 11:37:34.707540 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5cb1f967-1b64-497d-800e-781f0467441e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:34.722924 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:34 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1215 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:35.240520 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5cb1f967-1b64-497d-800e-781f0467441e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:35.240520 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5cb1f967-1b64-497d-800e-781f0467441e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1221 microversion: 2.1 time: 0.620297 Jan 10 11:37:35.240520 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 7/15] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:34 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1221 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:37:35.307007 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ab97171a-f93a-46d9-8741-c25db24f95ad tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] Calling method '.version_select at 0x7f477af32f70>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:35.396845 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-ab97171a-f93a-46d9-8741-c25db24f95ad tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] HTTP exception thrown: Volume 35c847e0-6f0a-4662-bbc2-1b0985449fd6 could not be found. Jan 10 11:37:35.398922 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ab97171a-f93a-46d9-8741-c25db24f95ad tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] Returning 404 to user: Volume 35c847e0-6f0a-4662-bbc2-1b0985449fd6 could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:37:35.400722 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ab97171a-f93a-46d9-8741-c25db24f95ad tempest-VolumesGetTestJSON-1825178490 tempest-VolumesGetTestJSON-1825178490-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/35c847e0-6f0a-4662-bbc2-1b0985449fd6" status: 404 len: 109 microversion: 2.1 time: 0.098105 Jan 10 11:37:35.404383 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 9/16] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jan 10 11:37:35 2022] GET /compute/v2.1/os-volumes/35c847e0-6f0a-4662-bbc2-1b0985449fd6 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:37:35.741033 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-68a9ea95-3b46-4b3c-9af6-cb8e03aaeb85 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:35.741664 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-68a9ea95-3b46-4b3c-9af6-cb8e03aaeb85 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:35.925769 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-68a9ea95-3b46-4b3c-9af6-cb8e03aaeb85 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:35.957685 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-68a9ea95-3b46-4b3c-9af6-cb8e03aaeb85 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1215 microversion: 2.1 time: 0.220438 Jan 10 11:37:35.961770 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 8/17] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:35 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1215 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:36.242155 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-1a030fa5-d4bb-4b39-b331-de1bae578309 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:36.242959 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-1a030fa5-d4bb-4b39-b331-de1bae578309 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:36.263486 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1a030fa5-d4bb-4b39-b331-de1bae578309 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:36.265338 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1a030fa5-d4bb-4b39-b331-de1bae578309 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:36.266984 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1a030fa5-d4bb-4b39-b331-de1bae578309 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:36.268195 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1a030fa5-d4bb-4b39-b331-de1bae578309 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:36.552848 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-1a030fa5-d4bb-4b39-b331-de1bae578309 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:36.580402 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-1a030fa5-d4bb-4b39-b331-de1bae578309 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1269 microversion: 2.1 time: 0.349105 Jan 10 11:37:36.595391 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 10/18] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:36 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1269 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:36.977142 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-769c1a20-6b9a-4175-bb2b-ee05c84fd0f5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:36.978434 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-769c1a20-6b9a-4175-bb2b-ee05c84fd0f5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:36.994617 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-769c1a20-6b9a-4175-bb2b-ee05c84fd0f5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:36.995146 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-769c1a20-6b9a-4175-bb2b-ee05c84fd0f5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:36.996016 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-769c1a20-6b9a-4175-bb2b-ee05c84fd0f5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:36.996470 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-769c1a20-6b9a-4175-bb2b-ee05c84fd0f5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:37.285038 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-769c1a20-6b9a-4175-bb2b-ee05c84fd0f5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:37.302672 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-769c1a20-6b9a-4175-bb2b-ee05c84fd0f5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1219 microversion: 2.1 time: 0.329124 Jan 10 11:37:37.303748 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 9/19] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:36 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1219 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:37.611932 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a50b96a5-466a-4661-b488-8c6d173b6859 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:37.613270 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a50b96a5-466a-4661-b488-8c6d173b6859 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:37.620822 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a50b96a5-466a-4661-b488-8c6d173b6859 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:37.621455 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a50b96a5-466a-4661-b488-8c6d173b6859 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:37.623588 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a50b96a5-466a-4661-b488-8c6d173b6859 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:37.624184 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a50b96a5-466a-4661-b488-8c6d173b6859 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:37.794523 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-a50b96a5-466a-4661-b488-8c6d173b6859 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:37.802238 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a50b96a5-466a-4661-b488-8c6d173b6859 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1269 microversion: 2.1 time: 0.193963 Jan 10 11:37:37.811641 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 11/20] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:37 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1269 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:38.321393 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-44baa447-3fad-4149-82ae-06c80cde87f2 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:38.323465 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-44baa447-3fad-4149-82ae-06c80cde87f2 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:38.330574 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-44baa447-3fad-4149-82ae-06c80cde87f2 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:38.340238 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-44baa447-3fad-4149-82ae-06c80cde87f2 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:38.341245 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-44baa447-3fad-4149-82ae-06c80cde87f2 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:38.341781 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-44baa447-3fad-4149-82ae-06c80cde87f2 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:38.494125 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-44baa447-3fad-4149-82ae-06c80cde87f2 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:38.501712 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-44baa447-3fad-4149-82ae-06c80cde87f2 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1219 microversion: 2.1 time: 0.185032 Jan 10 11:37:38.502318 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 10/21] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:38 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1219 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:38.812765 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-707d3319-c979-472c-9da1-8fb27bd87b8c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'create', calling method: .version_select at 0x7f477b855430>, body: {"keypair": {"name": "tempest-keypair-61070925"}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:37:38.819445 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-212d9d9e-880a-4de2-a940-f4cff090a80b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:38.820493 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-212d9d9e-880a-4de2-a940-f4cff090a80b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:38.831366 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-212d9d9e-880a-4de2-a940-f4cff090a80b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:38.832141 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-212d9d9e-880a-4de2-a940-f4cff090a80b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:38.833406 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-212d9d9e-880a-4de2-a940-f4cff090a80b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:38.834321 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-212d9d9e-880a-4de2-a940-f4cff090a80b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:38.839029 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-707d3319-c979-472c-9da1-8fb27bd87b8c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Getting quotas for project 274889e6213c4dfaab0997e2dad420ff. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:37:38.843668 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-707d3319-c979-472c-9da1-8fb27bd87b8c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Getting quotas for user 2c652557dbd54165a3498c08b2dd5673 and project 274889e6213c4dfaab0997e2dad420ff. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:37:38.921995 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-212d9d9e-880a-4de2-a940-f4cff090a80b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:38.932515 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-212d9d9e-880a-4de2-a940-f4cff090a80b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1269 microversion: 2.1 time: 0.116594 Jan 10 11:37:38.934258 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 11/22] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:38 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1269 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:37:39.393846 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-707d3319-c979-472c-9da1-8fb27bd87b8c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Getting quotas for project 274889e6213c4dfaab0997e2dad420ff. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:37:39.401064 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-707d3319-c979-472c-9da1-8fb27bd87b8c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Getting quotas for user 2c652557dbd54165a3498c08b2dd5673 and project 274889e6213c4dfaab0997e2dad420ff. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:37:39.443272 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-707d3319-c979-472c-9da1-8fb27bd87b8c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2314 microversion: 2.20 time: 0.755641 Jan 10 11:37:39.458891 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 12/23] 10.222.0.20 () {62 vars in 1198 bytes} [Mon Jan 10 11:37:38 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 772 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 10 11:37:39.523434 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-0324dde1-05c6-457c-a457-9c1639818798 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:39.524870 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-0324dde1-05c6-457c-a457-9c1639818798 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:39.540765 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0324dde1-05c6-457c-a457-9c1639818798 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:39.541749 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0324dde1-05c6-457c-a457-9c1639818798 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:39.542842 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0324dde1-05c6-457c-a457-9c1639818798 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:39.543801 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0324dde1-05c6-457c-a457-9c1639818798 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:39.699371 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-0324dde1-05c6-457c-a457-9c1639818798 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:39.720123 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-0324dde1-05c6-457c-a457-9c1639818798 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1211 microversion: 2.1 time: 0.195250 Jan 10 11:37:39.720123 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 12/24] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:39 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1211 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:39.955757 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-963327cd-527b-4a14-a25b-188fba3da413 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:39.957191 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-963327cd-527b-4a14-a25b-188fba3da413 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:39.980926 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-963327cd-527b-4a14-a25b-188fba3da413 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:39.981750 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-963327cd-527b-4a14-a25b-188fba3da413 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:39.984520 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-963327cd-527b-4a14-a25b-188fba3da413 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:39.985791 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-963327cd-527b-4a14-a25b-188fba3da413 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:40.448913 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-963327cd-527b-4a14-a25b-188fba3da413 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:40.464682 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-963327cd-527b-4a14-a25b-188fba3da413 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1277 microversion: 2.1 time: 0.516123 Jan 10 11:37:40.470634 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 13/25] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:39 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1277 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:40.733840 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-938277bd-9176-496b-a31c-b33321c07c64 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:40.738375 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-938277bd-9176-496b-a31c-b33321c07c64 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:40.762623 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-938277bd-9176-496b-a31c-b33321c07c64 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:40.763243 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-938277bd-9176-496b-a31c-b33321c07c64 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:40.776736 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-938277bd-9176-496b-a31c-b33321c07c64 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:40.778401 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-938277bd-9176-496b-a31c-b33321c07c64 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:41.041063 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-938277bd-9176-496b-a31c-b33321c07c64 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:41.058692 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-938277bd-9176-496b-a31c-b33321c07c64 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1267 microversion: 2.1 time: 0.328330 Jan 10 11:37:41.061962 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 13/26] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:40 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1267 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:41.495290 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-76e264d5-69e3-4491-aee7-584f1e69c0d6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:41.495980 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-76e264d5-69e3-4491-aee7-584f1e69c0d6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:41.542661 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-76e264d5-69e3-4491-aee7-584f1e69c0d6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:41.544645 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-76e264d5-69e3-4491-aee7-584f1e69c0d6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:41.545591 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-76e264d5-69e3-4491-aee7-584f1e69c0d6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:41.549178 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-76e264d5-69e3-4491-aee7-584f1e69c0d6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:42.030808 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-76e264d5-69e3-4491-aee7-584f1e69c0d6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:42.057544 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-76e264d5-69e3-4491-aee7-584f1e69c0d6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1275 microversion: 2.1 time: 0.573862 Jan 10 11:37:42.065679 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 14/27] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:41 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1275 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:42.085387 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-95a96d6c-bc91-4e2c-921a-4175186b78a9 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:42.086178 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-95a96d6c-bc91-4e2c-921a-4175186b78a9 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:42.095999 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-95a96d6c-bc91-4e2c-921a-4175186b78a9 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:42.096967 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-95a96d6c-bc91-4e2c-921a-4175186b78a9 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:42.101692 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-95a96d6c-bc91-4e2c-921a-4175186b78a9 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:42.104644 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-95a96d6c-bc91-4e2c-921a-4175186b78a9 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:42.668300 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-95a96d6c-bc91-4e2c-921a-4175186b78a9 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:42.679730 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-95a96d6c-bc91-4e2c-921a-4175186b78a9 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1285 microversion: 2.1 time: 0.607335 Jan 10 11:37:42.681223 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 14/28] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:42 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1285 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:43.093268 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-61572c39-9c2d-465f-b03c-5818c795ac84 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:43.093965 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-61572c39-9c2d-465f-b03c-5818c795ac84 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:43.105066 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-61572c39-9c2d-465f-b03c-5818c795ac84 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:43.105813 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-61572c39-9c2d-465f-b03c-5818c795ac84 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:43.109278 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-61572c39-9c2d-465f-b03c-5818c795ac84 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:43.112072 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-61572c39-9c2d-465f-b03c-5818c795ac84 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:43.276047 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-61572c39-9c2d-465f-b03c-5818c795ac84 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:43.301161 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-61572c39-9c2d-465f-b03c-5818c795ac84 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1275 microversion: 2.1 time: 0.211914 Jan 10 11:37:43.303358 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 15/29] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:43 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1275 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:43.701365 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3389db9e-127c-4bea-995d-3c7f7fc27306 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:43.708129 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3389db9e-127c-4bea-995d-3c7f7fc27306 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:43.756609 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3389db9e-127c-4bea-995d-3c7f7fc27306 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:43.760540 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3389db9e-127c-4bea-995d-3c7f7fc27306 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:43.767339 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3389db9e-127c-4bea-995d-3c7f7fc27306 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:43.771150 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3389db9e-127c-4bea-995d-3c7f7fc27306 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:44.329086 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3389db9e-127c-4bea-995d-3c7f7fc27306 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:44.349301 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3389db9e-127c-4bea-995d-3c7f7fc27306 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1273 microversion: 2.1 time: 0.654597 Jan 10 11:37:44.360567 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 16/30] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:43 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1273 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:45.031158 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-6faeabfa-123d-4001-9d1d-5b070e35c26d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1170187322", "imageRef": "b6e63192-9c33-4d80-9555-6de2bb10fd32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b7066df-867a-4f7f-8c8c-edef37acae0b"}]}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:37:45.044661 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7f015b4f-f102-47d2-93ee-7ec4c46eba98 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'create', calling method: .version_select at 0x7f477a5e6820>, body: {"keypair": {"name": "tempest-keypair-2037529567"}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:37:45.107453 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-7f015b4f-f102-47d2-93ee-7ec4c46eba98 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Getting quotas for project f8635cce808f4b1c9e754fe407a2f60b. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:37:45.124264 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-7f015b4f-f102-47d2-93ee-7ec4c46eba98 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Getting quotas for user 0a3ea138daa84701bbf756e1ec43fb4c and project f8635cce808f4b1c9e754fe407a2f60b. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:37:45.263214 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.network.neutron [None req-6faeabfa-123d-4001-9d1d-5b070e35c26d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] validate_networks() for [('0b7066df-867a-4f7f-8c8c-edef37acae0b', None, None, None, None, None)] {{(pid=128719) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:37:46.507773 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-7f015b4f-f102-47d2-93ee-7ec4c46eba98 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Getting quotas for project f8635cce808f4b1c9e754fe407a2f60b. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:37:46.519918 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-7f015b4f-f102-47d2-93ee-7ec4c46eba98 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Getting quotas for user 0a3ea138daa84701bbf756e1ec43fb4c and project f8635cce808f4b1c9e754fe407a2f60b. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:37:46.560116 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7f015b4f-f102-47d2-93ee-7ec4c46eba98 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 2.198223 Jan 10 11:37:46.585194 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 17/31] 10.222.0.20 () {60 vars in 1157 bytes} [Mon Jan 10 11:37:44 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 2224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:46.604387 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c42dfc4c-221e-4f4e-bed9-dafee21b3d10 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:46.604387 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c42dfc4c-221e-4f4e-bed9-dafee21b3d10 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:46.631141 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c42dfc4c-221e-4f4e-bed9-dafee21b3d10 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:46.631141 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c42dfc4c-221e-4f4e-bed9-dafee21b3d10 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:46.633049 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c42dfc4c-221e-4f4e-bed9-dafee21b3d10 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:46.633511 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c42dfc4c-221e-4f4e-bed9-dafee21b3d10 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:47.915168 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c42dfc4c-221e-4f4e-bed9-dafee21b3d10 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:47.935439 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c42dfc4c-221e-4f4e-bed9-dafee21b3d10 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 1.348470 Jan 10 11:37:47.936384 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 18/32] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:46 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:47.946190 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-246e91bf-eba5-4d64-bd94-705bfec86f15 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:47.946190 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-246e91bf-eba5-4d64-bd94-705bfec86f15 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:47.966756 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-246e91bf-eba5-4d64-bd94-705bfec86f15 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:47.969463 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-246e91bf-eba5-4d64-bd94-705bfec86f15 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:47.969463 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-246e91bf-eba5-4d64-bd94-705bfec86f15 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:47.970816 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-246e91bf-eba5-4d64-bd94-705bfec86f15 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:48.623596 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-6faeabfa-123d-4001-9d1d-5b070e35c26d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Flavor limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:37:48.624780 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-6faeabfa-123d-4001-9d1d-5b070e35c26d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Image limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:37:48.634490 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-6faeabfa-123d-4001-9d1d-5b070e35c26d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Flavor pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:37:48.635627 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-6faeabfa-123d-4001-9d1d-5b070e35c26d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Image pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:37:48.638839 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-6faeabfa-123d-4001-9d1d-5b070e35c26d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:37:48.669004 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6faeabfa-123d-4001-9d1d-5b070e35c26d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:48.669947 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6faeabfa-123d-4001-9d1d-5b070e35c26d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:48.671177 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6faeabfa-123d-4001-9d1d-5b070e35c26d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:48.672986 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6faeabfa-123d-4001-9d1d-5b070e35c26d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:48.705740 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-6faeabfa-123d-4001-9d1d-5b070e35c26d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Getting quotas for project a77ddb5f1ea14e54be79c194a288b5a7. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:37:48.710965 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-6faeabfa-123d-4001-9d1d-5b070e35c26d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Getting quotas for user 14216d42be0e4e1690f9a77a09e25967 and project a77ddb5f1ea14e54be79c194a288b5a7. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:37:48.728438 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-6faeabfa-123d-4001-9d1d-5b070e35c26d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Going to run 1 instances... {{(pid=128719) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:37:48.731293 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-6faeabfa-123d-4001-9d1d-5b070e35c26d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e63192-9c33-4d80-9555-6de2bb10fd32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:37:48.970172 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-6faeabfa-123d-4001-9d1d-5b070e35c26d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.426871 Jan 10 11:37:48.971372 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 15/33] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:37:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 5429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 11:37:48.981570 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b3af4789-052b-49ff-9233-4b2c645122e9 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:48.985610 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b3af4789-052b-49ff-9233-4b2c645122e9 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:49.009073 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b3af4789-052b-49ff-9233-4b2c645122e9 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:49.010761 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b3af4789-052b-49ff-9233-4b2c645122e9 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:49.015405 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b3af4789-052b-49ff-9233-4b2c645122e9 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:49.016083 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b3af4789-052b-49ff-9233-4b2c645122e9 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:49.266294 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-246e91bf-eba5-4d64-bd94-705bfec86f15 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:49.275220 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-246e91bf-eba5-4d64-bd94-705bfec86f15 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 1.337540 Jan 10 11:37:49.297818 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 19/34] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:47 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:49.302689 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-faed138c-038f-4be1-a593-0c5e3f92028e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:49.307316 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-faed138c-038f-4be1-a593-0c5e3f92028e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:49.655108 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-faed138c-038f-4be1-a593-0c5e3f92028e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:49.658472 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-faed138c-038f-4be1-a593-0c5e3f92028e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1222 microversion: 2.1 time: 0.359229 Jan 10 11:37:49.665450 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 20/35] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:49 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1222 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:49.751033 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-6dac9410-d47e-4292-b6b6-4669097224d6 req-6214aa7c-4bee-4bbe-b5ba-fd71073d5cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17641f31-456c-4c0f-8f40-5337b16bc6e0", "tag": "6d5c4e49-c1c6-44b3-8b26-b44d2d601cbc"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:37:49.753869 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:37:49.753869 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:37:49.775985 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-6dac9410-d47e-4292-b6b6-4669097224d6 req-6214aa7c-4bee-4bbe-b5ba-fd71073d5cf8 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:49.800854 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-6dac9410-d47e-4292-b6b6-4669097224d6 req-6214aa7c-4bee-4bbe-b5ba-fd71073d5cf8 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:49.864458 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-6dac9410-d47e-4292-b6b6-4669097224d6 req-6214aa7c-4bee-4bbe-b5ba-fd71073d5cf8 service nova] Creating event network-changed:6d5c4e49-c1c6-44b3-8b26-b44d2d601cbc for instance 17641f31-456c-4c0f-8f40-5337b16bc6e0 on hv-cinder-maste Jan 10 11:37:49.864458 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-6dac9410-d47e-4292-b6b6-4669097224d6 req-6214aa7c-4bee-4bbe-b5ba-fd71073d5cf8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128718) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 10 11:37:49.864458 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-21804c2c-0f9f-450a-bd1d-cbf00f4bfb95 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:49.864458 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-21804c2c-0f9f-450a-bd1d-cbf00f4bfb95 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:49.866834 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-21804c2c-0f9f-450a-bd1d-cbf00f4bfb95 None None] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:49.866834 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-21804c2c-0f9f-450a-bd1d-cbf00f4bfb95 None None] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:49.914037 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.compute.rpcapi [None req-21804c2c-0f9f-450a-bd1d-cbf00f4bfb95 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 10 11:37:49.914908 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-21804c2c-0f9f-450a-bd1d-cbf00f4bfb95 None None] Releasing lock "compute-rpcapi-router" {{(pid=128718) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 10 11:37:49.955877 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-21804c2c-0f9f-450a-bd1d-cbf00f4bfb95 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.289241 Jan 10 11:37:49.956746 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 21/36] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:37:50.032755 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-b3af4789-052b-49ff-9233-4b2c645122e9 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:50.041645 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-aa7b1847-f7e4-4e13-90e4-dfcda2cb4f4c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-85301130", "imageRef": "b6e63192-9c33-4d80-9555-6de2bb10fd32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b7066df-867a-4f7f-8c8c-edef37acae0b"}]}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:37:50.058766 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b3af4789-052b-49ff-9233-4b2c645122e9 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 1.086112 Jan 10 11:37:50.074466 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 16/37] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:48 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:50.190909 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.network.neutron [None req-aa7b1847-f7e4-4e13-90e4-dfcda2cb4f4c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] validate_networks() for [('0b7066df-867a-4f7f-8c8c-edef37acae0b', None, None, None, None, None)] {{(pid=128718) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:37:50.305456 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-82190c8e-9cd1-4706-8f43-932f96872b69 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:50.306201 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-82190c8e-9cd1-4706-8f43-932f96872b69 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:50.315781 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-82190c8e-9cd1-4706-8f43-932f96872b69 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:50.316399 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-82190c8e-9cd1-4706-8f43-932f96872b69 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:50.317405 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-82190c8e-9cd1-4706-8f43-932f96872b69 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:50.317972 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-82190c8e-9cd1-4706-8f43-932f96872b69 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:51.669805 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-82190c8e-9cd1-4706-8f43-932f96872b69 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:51.701035 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-82190c8e-9cd1-4706-8f43-932f96872b69 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 1.399899 Jan 10 11:37:51.701699 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 17/38] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:50 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:37:51.736078 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-38daa1bf-c09a-41f5-9574-e958573ad940 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:51.737175 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-38daa1bf-c09a-41f5-9574-e958573ad940 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:51.764020 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-38daa1bf-c09a-41f5-9574-e958573ad940 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:51.767456 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-38daa1bf-c09a-41f5-9574-e958573ad940 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:51.768721 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-38daa1bf-c09a-41f5-9574-e958573ad940 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:51.774675 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-38daa1bf-c09a-41f5-9574-e958573ad940 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:52.763536 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-38daa1bf-c09a-41f5-9574-e958573ad940 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:52.783447 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-38daa1bf-c09a-41f5-9574-e958573ad940 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 1.080508 Jan 10 11:37:52.796892 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 18/39] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:51 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:52.804318 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-57a03f5b-1e3c-456c-a66b-6e2d531d6e72 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:52.805750 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-57a03f5b-1e3c-456c-a66b-6e2d531d6e72 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:52.845941 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-57a03f5b-1e3c-456c-a66b-6e2d531d6e72 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:52.847107 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-57a03f5b-1e3c-456c-a66b-6e2d531d6e72 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:52.857903 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-57a03f5b-1e3c-456c-a66b-6e2d531d6e72 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:52.860613 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-57a03f5b-1e3c-456c-a66b-6e2d531d6e72 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:53.018951 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-aa7b1847-f7e4-4e13-90e4-dfcda2cb4f4c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Flavor limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:37:53.019695 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-aa7b1847-f7e4-4e13-90e4-dfcda2cb4f4c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Image limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:37:53.020395 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-aa7b1847-f7e4-4e13-90e4-dfcda2cb4f4c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Flavor pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:37:53.021240 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-aa7b1847-f7e4-4e13-90e4-dfcda2cb4f4c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Image pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:37:53.021708 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-aa7b1847-f7e4-4e13-90e4-dfcda2cb4f4c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:37:53.052970 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-aa7b1847-f7e4-4e13-90e4-dfcda2cb4f4c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:53.054030 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-aa7b1847-f7e4-4e13-90e4-dfcda2cb4f4c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:53.063490 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-aa7b1847-f7e4-4e13-90e4-dfcda2cb4f4c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:53.064001 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-aa7b1847-f7e4-4e13-90e4-dfcda2cb4f4c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:53.130195 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-aa7b1847-f7e4-4e13-90e4-dfcda2cb4f4c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Getting quotas for project a77ddb5f1ea14e54be79c194a288b5a7. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:37:53.147898 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-aa7b1847-f7e4-4e13-90e4-dfcda2cb4f4c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Getting quotas for user 14216d42be0e4e1690f9a77a09e25967 and project a77ddb5f1ea14e54be79c194a288b5a7. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:37:53.180933 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-aa7b1847-f7e4-4e13-90e4-dfcda2cb4f4c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Going to run 1 instances... {{(pid=128718) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:37:53.197802 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-aa7b1847-f7e4-4e13-90e4-dfcda2cb4f4c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e63192-9c33-4d80-9555-6de2bb10fd32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:37:53.429823 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-aa7b1847-f7e4-4e13-90e4-dfcda2cb4f4c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.393078 Jan 10 11:37:53.438660 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 22/40] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:37:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 3404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 11:37:53.453029 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-508e3273-4929-4aef-a43d-dfab2e1595e8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:53.460175 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-508e3273-4929-4aef-a43d-dfab2e1595e8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:53.705460 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-508e3273-4929-4aef-a43d-dfab2e1595e8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:53.705460 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-508e3273-4929-4aef-a43d-dfab2e1595e8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1220 microversion: 2.1 time: 0.255367 Jan 10 11:37:53.705460 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 23/41] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:53 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1220 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:53.804451 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3d04a9d8-571d-4b1d-a8b8-7db12e781ddf tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:53.805198 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3d04a9d8-571d-4b1d-a8b8-7db12e781ddf tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:53.824144 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3d04a9d8-571d-4b1d-a8b8-7db12e781ddf tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:53.836232 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3d04a9d8-571d-4b1d-a8b8-7db12e781ddf tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:53.836232 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3d04a9d8-571d-4b1d-a8b8-7db12e781ddf tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:53.836232 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3d04a9d8-571d-4b1d-a8b8-7db12e781ddf tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:54.784926 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-57a03f5b-1e3c-456c-a66b-6e2d531d6e72 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:54.799964 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-57a03f5b-1e3c-456c-a66b-6e2d531d6e72 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 2.003673 Jan 10 11:37:54.801435 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 19/42] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:52 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:54.823876 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3d04a9d8-571d-4b1d-a8b8-7db12e781ddf tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:54.842304 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3d04a9d8-571d-4b1d-a8b8-7db12e781ddf tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 1.031906 Jan 10 11:37:54.842304 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 24/43] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:53 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:37:54.842304 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4bf70907-7222-40bd-ae0a-f0695844d004 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2001842581", "imageRef": "b6e63192-9c33-4d80-9555-6de2bb10fd32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05ffc7ce-f421-4ef2-baa4-3ee4a31019b2"}], "security_groups": [{"name": "tempest-securitygroup--1040770389"}], "key_name": "tempest-keypair-61070925", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:37:55.261425 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-4091b9fe-ae00-4fd2-9324-b66fb76dcca3 req-2e3798e3-bad7-48bb-a5ae-8032555436af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6353ce19-8a0e-4424-ab1f-d6e822696c00", "tag": "0ea7b088-85a0-4b99-b5b6-5915fac5b55a"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:37:55.264470 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:37:55.264470 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:37:55.286175 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-4091b9fe-ae00-4fd2-9324-b66fb76dcca3 req-2e3798e3-bad7-48bb-a5ae-8032555436af service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:55.286949 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-4091b9fe-ae00-4fd2-9324-b66fb76dcca3 req-2e3798e3-bad7-48bb-a5ae-8032555436af service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:55.348202 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.network.neutron [None req-4bf70907-7222-40bd-ae0a-f0695844d004 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] validate_networks() for [('05ffc7ce-f421-4ef2-baa4-3ee4a31019b2', None, None, None, None, None)] {{(pid=128718) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:37:55.357236 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-4091b9fe-ae00-4fd2-9324-b66fb76dcca3 req-2e3798e3-bad7-48bb-a5ae-8032555436af service nova] Creating event network-changed:0ea7b088-85a0-4b99-b5b6-5915fac5b55a for instance 6353ce19-8a0e-4424-ab1f-d6e822696c00 on hv-cinder-maste Jan 10 11:37:55.357236 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-4091b9fe-ae00-4fd2-9324-b66fb76dcca3 req-2e3798e3-bad7-48bb-a5ae-8032555436af service nova] Acquired lock "compute-rpcapi-router" {{(pid=128719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 10 11:37:55.359302 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5d65ad97-6edc-4793-9870-3fff5ad97e19 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:55.360421 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5d65ad97-6edc-4793-9870-3fff5ad97e19 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:55.362945 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5d65ad97-6edc-4793-9870-3fff5ad97e19 None None] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:55.364092 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5d65ad97-6edc-4793-9870-3fff5ad97e19 None None] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:55.404927 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.compute.rpcapi [None req-5d65ad97-6edc-4793-9870-3fff5ad97e19 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 10 11:37:55.409872 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5d65ad97-6edc-4793-9870-3fff5ad97e19 None None] Releasing lock "compute-rpcapi-router" {{(pid=128719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 10 11:37:55.495933 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5d65ad97-6edc-4793-9870-3fff5ad97e19 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.666483 Jan 10 11:37:55.504930 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 20/44] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:37:55.519854 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a2eb64ad-0b53-4ea7-b336-9fd9ffc467d6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:55.521175 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a2eb64ad-0b53-4ea7-b336-9fd9ffc467d6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:55.547324 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a2eb64ad-0b53-4ea7-b336-9fd9ffc467d6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:55.548035 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a2eb64ad-0b53-4ea7-b336-9fd9ffc467d6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:55.549364 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a2eb64ad-0b53-4ea7-b336-9fd9ffc467d6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:55.550018 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a2eb64ad-0b53-4ea7-b336-9fd9ffc467d6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:55.847431 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a2eb64ad-0b53-4ea7-b336-9fd9ffc467d6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:55.874178 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a2eb64ad-0b53-4ea7-b336-9fd9ffc467d6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1224 microversion: 2.1 time: 0.367675 Jan 10 11:37:55.874709 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 21/45] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:55 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1224 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:55.903026 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9018fc2d-5e28-4b90-9bea-dbcf51683b9d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:55.903662 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9018fc2d-5e28-4b90-9bea-dbcf51683b9d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:55.924857 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9018fc2d-5e28-4b90-9bea-dbcf51683b9d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:55.927893 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9018fc2d-5e28-4b90-9bea-dbcf51683b9d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:55.930804 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9018fc2d-5e28-4b90-9bea-dbcf51683b9d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:55.931474 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9018fc2d-5e28-4b90-9bea-dbcf51683b9d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:56.746239 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9018fc2d-5e28-4b90-9bea-dbcf51683b9d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:56.785220 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9018fc2d-5e28-4b90-9bea-dbcf51683b9d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 0.907664 Jan 10 11:37:56.802331 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 22/46] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:55 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:56.823418 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-185522c4-22ee-4e96-ae78-b15604c59b82 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:56.824350 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-185522c4-22ee-4e96-ae78-b15604c59b82 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:56.860212 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-185522c4-22ee-4e96-ae78-b15604c59b82 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:56.861477 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-185522c4-22ee-4e96-ae78-b15604c59b82 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:56.863854 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-185522c4-22ee-4e96-ae78-b15604c59b82 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:56.865677 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-185522c4-22ee-4e96-ae78-b15604c59b82 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:57.320522 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-4bf70907-7222-40bd-ae0a-f0695844d004 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Flavor limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:37:57.322482 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-4bf70907-7222-40bd-ae0a-f0695844d004 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Image limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:37:57.322482 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-4bf70907-7222-40bd-ae0a-f0695844d004 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Flavor pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:37:57.322482 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-4bf70907-7222-40bd-ae0a-f0695844d004 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Image pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:37:57.322482 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-4bf70907-7222-40bd-ae0a-f0695844d004 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:37:57.349076 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4bf70907-7222-40bd-ae0a-f0695844d004 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:57.350900 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4bf70907-7222-40bd-ae0a-f0695844d004 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:57.354279 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4bf70907-7222-40bd-ae0a-f0695844d004 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:57.355512 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4bf70907-7222-40bd-ae0a-f0695844d004 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:57.421893 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-4bf70907-7222-40bd-ae0a-f0695844d004 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Getting quotas for project 274889e6213c4dfaab0997e2dad420ff. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:37:57.428072 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-4bf70907-7222-40bd-ae0a-f0695844d004 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Getting quotas for user 2c652557dbd54165a3498c08b2dd5673 and project 274889e6213c4dfaab0997e2dad420ff. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:37:57.463618 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4bf70907-7222-40bd-ae0a-f0695844d004 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Going to run 1 instances... {{(pid=128718) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:37:57.471765 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4bf70907-7222-40bd-ae0a-f0695844d004 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e63192-9c33-4d80-9555-6de2bb10fd32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:37:57.657729 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-185522c4-22ee-4e96-ae78-b15604c59b82 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:57.669355 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-185522c4-22ee-4e96-ae78-b15604c59b82 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 0.864476 Jan 10 11:37:57.670144 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 23/47] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:56 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:57.681750 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-550c48ec-eced-4d0f-8a15-c170f477d667 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:57.693587 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-550c48ec-eced-4d0f-8a15-c170f477d667 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:57.701939 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-550c48ec-eced-4d0f-8a15-c170f477d667 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:57.703011 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-550c48ec-eced-4d0f-8a15-c170f477d667 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:57.706041 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-550c48ec-eced-4d0f-8a15-c170f477d667 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:57.707318 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-550c48ec-eced-4d0f-8a15-c170f477d667 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:57.773995 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4bf70907-7222-40bd-ae0a-f0695844d004 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.936300 Jan 10 11:37:57.781044 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 25/48] 10.222.0.20 () {62 vars in 1187 bytes} [Mon Jan 10 11:37:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 2946 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 10 11:37:57.788043 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ba5c0271-de52-4e2e-b62f-116a455d45fb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1543236686", "imageRef": "b6e63192-9c33-4d80-9555-6de2bb10fd32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "757f6b2b-0d86-4b1c-8fbb-5ee1a7cfe7ea"}], "security_groups": [{"name": "tempest-securitygroup--2119331622"}], "key_name": "tempest-keypair-2037529567", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:37:57.863286 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-550c48ec-eced-4d0f-8a15-c170f477d667 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:57.878739 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-550c48ec-eced-4d0f-8a15-c170f477d667 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1272 microversion: 2.1 time: 0.201282 Jan 10 11:37:57.879449 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 24/49] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:57 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1272 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:57.898250 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-647ade77-3736-4a08-a3a9-03211ff0f295 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:57.898250 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-647ade77-3736-4a08-a3a9-03211ff0f295 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:58.013399 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-647ade77-3736-4a08-a3a9-03211ff0f295 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:58.022554 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-647ade77-3736-4a08-a3a9-03211ff0f295 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:58.029554 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-647ade77-3736-4a08-a3a9-03211ff0f295 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:58.032705 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-647ade77-3736-4a08-a3a9-03211ff0f295 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1280 microversion: 2.20 time: 0.140172 Jan 10 11:37:58.033896 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 25/50] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:37:57 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1280 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:37:58.040332 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5eaf896c-d61b-4cea-8cb0-4f3d1dfca3ca tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:58.041415 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5eaf896c-d61b-4cea-8cb0-4f3d1dfca3ca tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:58.048575 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5eaf896c-d61b-4cea-8cb0-4f3d1dfca3ca tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:58.051532 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5eaf896c-d61b-4cea-8cb0-4f3d1dfca3ca tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:58.052926 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5eaf896c-d61b-4cea-8cb0-4f3d1dfca3ca tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:58.054426 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5eaf896c-d61b-4cea-8cb0-4f3d1dfca3ca tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:58.065202 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.network.neutron [None req-ba5c0271-de52-4e2e-b62f-116a455d45fb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] validate_networks() for [('757f6b2b-0d86-4b1c-8fbb-5ee1a7cfe7ea', None, None, None, None, None)] {{(pid=128718) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:37:58.492851 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5eaf896c-d61b-4cea-8cb0-4f3d1dfca3ca tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:58.504951 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5eaf896c-d61b-4cea-8cb0-4f3d1dfca3ca tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 0.469651 Jan 10 11:37:58.505556 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 26/51] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:58 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:58.692649 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-15faf1dd-abba-40e5-acc7-7bbdc8c12014 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:58.695485 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-15faf1dd-abba-40e5-acc7-7bbdc8c12014 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:58.722863 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-15faf1dd-abba-40e5-acc7-7bbdc8c12014 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:58.722863 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-15faf1dd-abba-40e5-acc7-7bbdc8c12014 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:58.722863 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-15faf1dd-abba-40e5-acc7-7bbdc8c12014 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:58.728740 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-15faf1dd-abba-40e5-acc7-7bbdc8c12014 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:58.988391 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-ba5c0271-de52-4e2e-b62f-116a455d45fb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Flavor limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:37:58.989059 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-ba5c0271-de52-4e2e-b62f-116a455d45fb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Image limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:37:58.989431 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-ba5c0271-de52-4e2e-b62f-116a455d45fb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Flavor pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:37:58.990131 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-ba5c0271-de52-4e2e-b62f-116a455d45fb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Image pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:37:58.990667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-ba5c0271-de52-4e2e-b62f-116a455d45fb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:37:59.006744 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ba5c0271-de52-4e2e-b62f-116a455d45fb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:59.006744 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ba5c0271-de52-4e2e-b62f-116a455d45fb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:59.006744 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ba5c0271-de52-4e2e-b62f-116a455d45fb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:59.006744 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ba5c0271-de52-4e2e-b62f-116a455d45fb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:59.027170 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-ba5c0271-de52-4e2e-b62f-116a455d45fb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Getting quotas for project f8635cce808f4b1c9e754fe407a2f60b. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:37:59.032115 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-ba5c0271-de52-4e2e-b62f-116a455d45fb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Getting quotas for user 0a3ea138daa84701bbf756e1ec43fb4c and project f8635cce808f4b1c9e754fe407a2f60b. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:37:59.047890 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-15faf1dd-abba-40e5-acc7-7bbdc8c12014 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:59.050874 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ba5c0271-de52-4e2e-b62f-116a455d45fb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Going to run 1 instances... {{(pid=128718) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:37:59.054914 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ba5c0271-de52-4e2e-b62f-116a455d45fb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e63192-9c33-4d80-9555-6de2bb10fd32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:37:59.056671 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-15faf1dd-abba-40e5-acc7-7bbdc8c12014 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 0.370771 Jan 10 11:37:59.069406 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 27/52] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:58 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:59.076489 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-85873d0f-bc08-46de-b332-4c3628f4ebb3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:59.077581 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-85873d0f-bc08-46de-b332-4c3628f4ebb3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:59.089893 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-85873d0f-bc08-46de-b332-4c3628f4ebb3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:59.091014 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-85873d0f-bc08-46de-b332-4c3628f4ebb3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:59.092320 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-85873d0f-bc08-46de-b332-4c3628f4ebb3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:59.093094 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-85873d0f-bc08-46de-b332-4c3628f4ebb3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:59.171657 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-85873d0f-bc08-46de-b332-4c3628f4ebb3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:59.180671 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-85873d0f-bc08-46de-b332-4c3628f4ebb3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1278 microversion: 2.1 time: 0.107497 Jan 10 11:37:59.181445 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 28/53] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:59 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1278 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:37:59.187903 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-38a4d202-fe2c-4f8e-b287-d13f22a37ac8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:59.188526 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-38a4d202-fe2c-4f8e-b287-d13f22a37ac8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:59.259682 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-38a4d202-fe2c-4f8e-b287-d13f22a37ac8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:59.268126 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-38a4d202-fe2c-4f8e-b287-d13f22a37ac8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:59.269872 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-38a4d202-fe2c-4f8e-b287-d13f22a37ac8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:59.271062 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-38a4d202-fe2c-4f8e-b287-d13f22a37ac8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1280 microversion: 2.20 time: 0.088584 Jan 10 11:37:59.279417 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 29/54] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:37:59 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:37:59.419025 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ba5c0271-de52-4e2e-b62f-116a455d45fb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.626756 Jan 10 11:37:59.419025 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 26/55] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:37:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 11:37:59.424248 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a7f5adba-f01c-4298-b267-cf4a4a581376 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:59.424878 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a7f5adba-f01c-4298-b267-cf4a4a581376 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:59.502984 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a7f5adba-f01c-4298-b267-cf4a4a581376 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:59.516129 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a7f5adba-f01c-4298-b267-cf4a4a581376 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1238 microversion: 2.1 time: 0.095607 Jan 10 11:37:59.527592 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 30/56] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:59 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1238 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:37:59.530819 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-288c77b7-ffa1-4859-be2f-3f8d06dd324d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:37:59.531722 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-288c77b7-ffa1-4859-be2f-3f8d06dd324d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:37:59.546411 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-288c77b7-ffa1-4859-be2f-3f8d06dd324d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:59.547781 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-288c77b7-ffa1-4859-be2f-3f8d06dd324d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:59.549007 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-288c77b7-ffa1-4859-be2f-3f8d06dd324d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:59.549645 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-288c77b7-ffa1-4859-be2f-3f8d06dd324d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:59.777805 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-8509042c-1f4c-44d8-904d-938acb5bfcd8 req-848faffd-b645-462e-abb3-7b01c230861d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bb75a87-2b05-43d3-b570-a04858874b50", "tag": "94a56965-edf5-4d72-b69a-a0f3ecd10498"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:37:59.779851 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:37:59.779851 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:37:59.789629 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-8509042c-1f4c-44d8-904d-938acb5bfcd8 req-848faffd-b645-462e-abb3-7b01c230861d service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:37:59.790382 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-8509042c-1f4c-44d8-904d-938acb5bfcd8 req-848faffd-b645-462e-abb3-7b01c230861d service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:37:59.804090 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-8509042c-1f4c-44d8-904d-938acb5bfcd8 req-848faffd-b645-462e-abb3-7b01c230861d service nova] Creating event network-changed:94a56965-edf5-4d72-b69a-a0f3ecd10498 for instance 9bb75a87-2b05-43d3-b570-a04858874b50 on hv-cinder-maste Jan 10 11:37:59.819059 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-8509042c-1f4c-44d8-904d-938acb5bfcd8 req-848faffd-b645-462e-abb3-7b01c230861d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040669 Jan 10 11:37:59.820320 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 31/57] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:37:59.847688 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-288c77b7-ffa1-4859-be2f-3f8d06dd324d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:37:59.857965 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-288c77b7-ffa1-4859-be2f-3f8d06dd324d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 0.336707 Jan 10 11:37:59.873174 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 27/58] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:37:59 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:00.083103 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3f13dbd7-998f-4163-9314-2fffd263cd5d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:00.083103 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-3f13dbd7-998f-4163-9314-2fffd263cd5d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:00.107631 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3f13dbd7-998f-4163-9314-2fffd263cd5d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:00.108729 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3f13dbd7-998f-4163-9314-2fffd263cd5d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:00.110048 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3f13dbd7-998f-4163-9314-2fffd263cd5d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:00.110841 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3f13dbd7-998f-4163-9314-2fffd263cd5d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:00.198671 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-bfa606dd-4baf-49cb-bea9-292a2d1c0e56 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:00.199401 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-bfa606dd-4baf-49cb-bea9-292a2d1c0e56 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:00.205642 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bfa606dd-4baf-49cb-bea9-292a2d1c0e56 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:00.206479 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bfa606dd-4baf-49cb-bea9-292a2d1c0e56 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:00.207485 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bfa606dd-4baf-49cb-bea9-292a2d1c0e56 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:00.208097 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bfa606dd-4baf-49cb-bea9-292a2d1c0e56 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:00.378411 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-3f13dbd7-998f-4163-9314-2fffd263cd5d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:00.391777 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3f13dbd7-998f-4163-9314-2fffd263cd5d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 0.318425 Jan 10 11:38:00.392953 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 32/59] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:00 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:00.401571 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e7e1d2e1-d144-441b-8825-ab472aa74edc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:00.404405 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-e7e1d2e1-d144-441b-8825-ab472aa74edc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:00.456046 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e7e1d2e1-d144-441b-8825-ab472aa74edc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:00.458379 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e7e1d2e1-d144-441b-8825-ab472aa74edc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:00.463406 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e7e1d2e1-d144-441b-8825-ab472aa74edc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:00.464829 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e7e1d2e1-d144-441b-8825-ab472aa74edc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:00.526852 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-bfa606dd-4baf-49cb-bea9-292a2d1c0e56 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:00.547479 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-bfa606dd-4baf-49cb-bea9-292a2d1c0e56 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1320 microversion: 2.1 time: 0.353405 Jan 10 11:38:00.558248 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 28/60] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:00 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1320 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:00.572530 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e262d3df-c2da-41ea-a878-473cb6894ba8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:00.576702 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e262d3df-c2da-41ea-a878-473cb6894ba8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:00.597209 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-e7e1d2e1-d144-441b-8825-ab472aa74edc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:00.608030 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-e7e1d2e1-d144-441b-8825-ab472aa74edc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:00.610125 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-e7e1d2e1-d144-441b-8825-ab472aa74edc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:00.611344 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-e7e1d2e1-d144-441b-8825-ab472aa74edc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1284 microversion: 2.20 time: 0.216449 Jan 10 11:38:00.612074 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 33/61] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:00 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1284 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:38:00.699187 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-e262d3df-c2da-41ea-a878-473cb6894ba8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:00.713576 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e262d3df-c2da-41ea-a878-473cb6894ba8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1238 microversion: 2.1 time: 0.162293 Jan 10 11:38:00.716069 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 29/62] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:00 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1238 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:00.881151 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-076bc930-bdc6-41e4-aba9-de958056c66d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:00.883104 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-076bc930-bdc6-41e4-aba9-de958056c66d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:00.892677 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-076bc930-bdc6-41e4-aba9-de958056c66d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:00.893137 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-076bc930-bdc6-41e4-aba9-de958056c66d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:00.894201 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-076bc930-bdc6-41e4-aba9-de958056c66d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:00.895303 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-076bc930-bdc6-41e4-aba9-de958056c66d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:01.077432 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-076bc930-bdc6-41e4-aba9-de958056c66d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:01.099962 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-076bc930-bdc6-41e4-aba9-de958056c66d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 0.227191 Jan 10 11:38:01.111473 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 34/63] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:00 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:01.410912 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ac2c10f7-5eb1-41f1-8d47-dec34ac251f5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:01.411726 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ac2c10f7-5eb1-41f1-8d47-dec34ac251f5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:01.419650 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ac2c10f7-5eb1-41f1-8d47-dec34ac251f5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:01.420352 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ac2c10f7-5eb1-41f1-8d47-dec34ac251f5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:01.425136 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ac2c10f7-5eb1-41f1-8d47-dec34ac251f5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:01.425136 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ac2c10f7-5eb1-41f1-8d47-dec34ac251f5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:01.585780 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ee258cdd-28a1-4733-9f28-2f8dca31a4b7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:01.585780 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ee258cdd-28a1-4733-9f28-2f8dca31a4b7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:01.585780 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ee258cdd-28a1-4733-9f28-2f8dca31a4b7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:01.585780 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ee258cdd-28a1-4733-9f28-2f8dca31a4b7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:01.586353 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ee258cdd-28a1-4733-9f28-2f8dca31a4b7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:01.586353 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ee258cdd-28a1-4733-9f28-2f8dca31a4b7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:01.671427 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ac2c10f7-5eb1-41f1-8d47-dec34ac251f5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:01.680157 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ac2c10f7-5eb1-41f1-8d47-dec34ac251f5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 0.272781 Jan 10 11:38:01.681086 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 30/64] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:01 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:01.686339 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-09c176ea-6243-459e-b110-7516bbd44230 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:01.687268 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-09c176ea-6243-459e-b110-7516bbd44230 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:01.693780 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-09c176ea-6243-459e-b110-7516bbd44230 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:01.694455 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-09c176ea-6243-459e-b110-7516bbd44230 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:01.695571 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-09c176ea-6243-459e-b110-7516bbd44230 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:01.696136 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-09c176ea-6243-459e-b110-7516bbd44230 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:01.803402 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-09c176ea-6243-459e-b110-7516bbd44230 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:01.827353 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-09c176ea-6243-459e-b110-7516bbd44230 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:01.829329 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-09c176ea-6243-459e-b110-7516bbd44230 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:01.835662 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-09c176ea-6243-459e-b110-7516bbd44230 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1332 microversion: 2.20 time: 0.151972 Jan 10 11:38:01.836290 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 31/65] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:01 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1332 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:38:01.853460 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-d1637b35-b089-4913-8f8a-84e0cf400525 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:01.854179 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-d1637b35-b089-4913-8f8a-84e0cf400525 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:01.887160 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d1637b35-b089-4913-8f8a-84e0cf400525 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:01.887837 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d1637b35-b089-4913-8f8a-84e0cf400525 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:01.889369 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d1637b35-b089-4913-8f8a-84e0cf400525 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:01.890010 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d1637b35-b089-4913-8f8a-84e0cf400525 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:02.046630 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-d1637b35-b089-4913-8f8a-84e0cf400525 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:02.065924 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-d1637b35-b089-4913-8f8a-84e0cf400525 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1242 microversion: 2.1 time: 0.227847 Jan 10 11:38:02.072953 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 32/66] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:01 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1242 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:02.119239 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-49949b48-1e4f-4e9a-a1f7-96db838626a5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:02.119877 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-49949b48-1e4f-4e9a-a1f7-96db838626a5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:02.125280 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ee258cdd-28a1-4733-9f28-2f8dca31a4b7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:02.133205 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-49949b48-1e4f-4e9a-a1f7-96db838626a5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:02.135810 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-49949b48-1e4f-4e9a-a1f7-96db838626a5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:02.139051 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-49949b48-1e4f-4e9a-a1f7-96db838626a5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:02.141171 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-49949b48-1e4f-4e9a-a1f7-96db838626a5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:02.143166 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ee258cdd-28a1-4733-9f28-2f8dca31a4b7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1320 microversion: 2.1 time: 0.577074 Jan 10 11:38:02.161367 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 35/67] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:01 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1320 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:02.428478 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-c9febad4-590c-4432-825e-7332fadea4d0 req-671c9d1a-7563-40ef-917c-b75e7c97f69c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1da86e35-89e4-462a-bac2-19a859b044ef", "tag": "78489ff4-6ec9-4d77-ad90-108d911867f2"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:02.431012 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:38:02.431012 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:38:02.452752 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-c9febad4-590c-4432-825e-7332fadea4d0 req-671c9d1a-7563-40ef-917c-b75e7c97f69c service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:02.457408 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-c9febad4-590c-4432-825e-7332fadea4d0 req-671c9d1a-7563-40ef-917c-b75e7c97f69c service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:02.497442 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-c9febad4-590c-4432-825e-7332fadea4d0 req-671c9d1a-7563-40ef-917c-b75e7c97f69c service nova] Creating event network-changed:78489ff4-6ec9-4d77-ad90-108d911867f2 for instance 1da86e35-89e4-462a-bac2-19a859b044ef on hv-cinder-maste Jan 10 11:38:02.509665 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-c9febad4-590c-4432-825e-7332fadea4d0 req-671c9d1a-7563-40ef-917c-b75e7c97f69c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088012 Jan 10 11:38:02.521424 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 36/68] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:38:02.642783 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-49949b48-1e4f-4e9a-a1f7-96db838626a5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:02.655560 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-49949b48-1e4f-4e9a-a1f7-96db838626a5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 0.540635 Jan 10 11:38:02.658933 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 33/69] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:02 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:02.712575 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-65169b6f-e587-454c-9096-7a84ca69f51d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:02.716948 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-65169b6f-e587-454c-9096-7a84ca69f51d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:02.744740 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-65169b6f-e587-454c-9096-7a84ca69f51d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:02.745437 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-65169b6f-e587-454c-9096-7a84ca69f51d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:02.746838 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-65169b6f-e587-454c-9096-7a84ca69f51d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:02.751566 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-65169b6f-e587-454c-9096-7a84ca69f51d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:02.876841 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e1e41c27-6313-4fb8-83a4-d979e5b549a7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:02.878168 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e1e41c27-6313-4fb8-83a4-d979e5b549a7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:02.901629 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e1e41c27-6313-4fb8-83a4-d979e5b549a7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:02.903459 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e1e41c27-6313-4fb8-83a4-d979e5b549a7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:02.904953 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e1e41c27-6313-4fb8-83a4-d979e5b549a7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:02.908538 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e1e41c27-6313-4fb8-83a4-d979e5b549a7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:03.129734 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-e1e41c27-6313-4fb8-83a4-d979e5b549a7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:03.143984 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-e1e41c27-6313-4fb8-83a4-d979e5b549a7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:03.146668 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-e1e41c27-6313-4fb8-83a4-d979e5b549a7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:03.149623 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e1e41c27-6313-4fb8-83a4-d979e5b549a7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1338 microversion: 2.20 time: 0.287670 Jan 10 11:38:03.165975 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 34/70] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:02 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1338 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:38:03.179414 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-801b23c6-2b95-4b22-89e5-4d0299efee8c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:03.200851 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-801b23c6-2b95-4b22-89e5-4d0299efee8c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:03.200851 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-801b23c6-2b95-4b22-89e5-4d0299efee8c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:03.200851 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-801b23c6-2b95-4b22-89e5-4d0299efee8c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:03.200851 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-801b23c6-2b95-4b22-89e5-4d0299efee8c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:03.203727 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-801b23c6-2b95-4b22-89e5-4d0299efee8c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:03.211621 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-65169b6f-e587-454c-9096-7a84ca69f51d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:03.224866 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-65169b6f-e587-454c-9096-7a84ca69f51d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 0.531006 Jan 10 11:38:03.236320 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 37/71] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:02 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:03.253018 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-99ba4ad9-3e61-4f80-8210-d4b9fff899c5 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:03.257549 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-99ba4ad9-3e61-4f80-8210-d4b9fff899c5 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:03.262515 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-99ba4ad9-3e61-4f80-8210-d4b9fff899c5 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:03.263328 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-99ba4ad9-3e61-4f80-8210-d4b9fff899c5 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:03.276094 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-99ba4ad9-3e61-4f80-8210-d4b9fff899c5 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:03.276615 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-99ba4ad9-3e61-4f80-8210-d4b9fff899c5 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:03.324531 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-801b23c6-2b95-4b22-89e5-4d0299efee8c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:03.339086 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-801b23c6-2b95-4b22-89e5-4d0299efee8c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1290 microversion: 2.1 time: 0.169832 Jan 10 11:38:03.340513 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 35/72] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:03 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1290 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:03.682322 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f0997049-f82c-4cd5-88c3-8ee5b4f3f00c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:03.683345 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f0997049-f82c-4cd5-88c3-8ee5b4f3f00c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:03.706668 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f0997049-f82c-4cd5-88c3-8ee5b4f3f00c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:03.710829 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f0997049-f82c-4cd5-88c3-8ee5b4f3f00c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:03.720389 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f0997049-f82c-4cd5-88c3-8ee5b4f3f00c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:03.721385 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-99ba4ad9-3e61-4f80-8210-d4b9fff899c5 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:03.729356 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f0997049-f82c-4cd5-88c3-8ee5b4f3f00c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:03.749250 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-99ba4ad9-3e61-4f80-8210-d4b9fff899c5 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1320 microversion: 2.1 time: 0.511278 Jan 10 11:38:03.751227 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 38/73] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:03 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1320 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:04.023975 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f0997049-f82c-4cd5-88c3-8ee5b4f3f00c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:04.037427 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f0997049-f82c-4cd5-88c3-8ee5b4f3f00c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 0.366310 Jan 10 11:38:04.039808 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 36/74] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:03 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:04.191206 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ffaf015f-99e4-4a85-90ed-cb6b553e02d5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:04.195227 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ffaf015f-99e4-4a85-90ed-cb6b553e02d5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:04.219478 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ffaf015f-99e4-4a85-90ed-cb6b553e02d5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:04.230566 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ffaf015f-99e4-4a85-90ed-cb6b553e02d5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:04.236037 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ffaf015f-99e4-4a85-90ed-cb6b553e02d5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:04.237619 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ffaf015f-99e4-4a85-90ed-cb6b553e02d5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:04.246506 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-d35e6824-bed0-431d-b7a3-befcfd94e3b0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:04.247359 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-d35e6824-bed0-431d-b7a3-befcfd94e3b0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:04.256222 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d35e6824-bed0-431d-b7a3-befcfd94e3b0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:04.258875 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d35e6824-bed0-431d-b7a3-befcfd94e3b0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:04.265517 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d35e6824-bed0-431d-b7a3-befcfd94e3b0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:04.265517 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d35e6824-bed0-431d-b7a3-befcfd94e3b0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:04.901638 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ffaf015f-99e4-4a85-90ed-cb6b553e02d5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:04.907020 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-d35e6824-bed0-431d-b7a3-befcfd94e3b0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:04.914623 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-d35e6824-bed0-431d-b7a3-befcfd94e3b0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 0.674989 Jan 10 11:38:04.914841 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ffaf015f-99e4-4a85-90ed-cb6b553e02d5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:04.917982 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 37/75] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:04 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:04.920620 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ffaf015f-99e4-4a85-90ed-cb6b553e02d5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:04.935523 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ffaf015f-99e4-4a85-90ed-cb6b553e02d5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1406 microversion: 2.20 time: 0.739529 Jan 10 11:38:04.935718 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-59ea5387-a9d4-4b40-aca2-1c01475748eb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:04.935718 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-59ea5387-a9d4-4b40-aca2-1c01475748eb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:04.936015 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:04 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1406 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:38:04.936166 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-59ea5387-a9d4-4b40-aca2-1c01475748eb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:04.936166 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-59ea5387-a9d4-4b40-aca2-1c01475748eb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:04.936166 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-59ea5387-a9d4-4b40-aca2-1c01475748eb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:04.936166 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-59ea5387-a9d4-4b40-aca2-1c01475748eb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:04.945232 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ee743bfd-063e-4265-83a9-e0aeccfc0149 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:04.945857 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ee743bfd-063e-4265-83a9-e0aeccfc0149 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:04.956822 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ee743bfd-063e-4265-83a9-e0aeccfc0149 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:04.957511 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ee743bfd-063e-4265-83a9-e0aeccfc0149 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:04.958614 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ee743bfd-063e-4265-83a9-e0aeccfc0149 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:04.959069 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ee743bfd-063e-4265-83a9-e0aeccfc0149 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:05.430026 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-59ea5387-a9d4-4b40-aca2-1c01475748eb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:05.439128 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ee743bfd-063e-4265-83a9-e0aeccfc0149 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:05.441487 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-59ea5387-a9d4-4b40-aca2-1c01475748eb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1364 microversion: 2.1 time: 0.522318 Jan 10 11:38:05.442620 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 38/77] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:04 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1364 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:05.450270 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-61355dd9-82ac-4a51-9d69-4f12df4f728c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:05.451251 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-61355dd9-82ac-4a51-9d69-4f12df4f728c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:05.455248 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ee743bfd-063e-4265-83a9-e0aeccfc0149 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1320 microversion: 2.1 time: 0.528990 Jan 10 11:38:05.466922 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 40/78] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:04 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1320 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:05.470773 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-61355dd9-82ac-4a51-9d69-4f12df4f728c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:05.471512 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-61355dd9-82ac-4a51-9d69-4f12df4f728c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:05.472590 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-61355dd9-82ac-4a51-9d69-4f12df4f728c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:05.473241 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-61355dd9-82ac-4a51-9d69-4f12df4f728c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:05.635512 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-61355dd9-82ac-4a51-9d69-4f12df4f728c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:05.643917 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-61355dd9-82ac-4a51-9d69-4f12df4f728c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 0.199602 Jan 10 11:38:05.645076 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 39/79] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:05 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:05.936162 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b4938eb4-8d22-4d40-a96e-d51ccd06f56c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:05.939113 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b4938eb4-8d22-4d40-a96e-d51ccd06f56c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:05.948510 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-558b4f5f-f009-4b57-81de-f33188bdbf75 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:05.949110 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-558b4f5f-f009-4b57-81de-f33188bdbf75 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:05.950253 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b4938eb4-8d22-4d40-a96e-d51ccd06f56c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:05.951087 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b4938eb4-8d22-4d40-a96e-d51ccd06f56c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:05.952968 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b4938eb4-8d22-4d40-a96e-d51ccd06f56c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:05.953635 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b4938eb4-8d22-4d40-a96e-d51ccd06f56c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:05.958599 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-558b4f5f-f009-4b57-81de-f33188bdbf75 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:05.962234 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-558b4f5f-f009-4b57-81de-f33188bdbf75 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:05.963214 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-558b4f5f-f009-4b57-81de-f33188bdbf75 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:05.963845 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-558b4f5f-f009-4b57-81de-f33188bdbf75 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:06.323841 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-558b4f5f-f009-4b57-81de-f33188bdbf75 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:06.332194 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-558b4f5f-f009-4b57-81de-f33188bdbf75 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:06.333730 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-558b4f5f-f009-4b57-81de-f33188bdbf75 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:06.334946 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-558b4f5f-f009-4b57-81de-f33188bdbf75 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1406 microversion: 2.20 time: 0.391594 Jan 10 11:38:06.342903 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 40/80] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:05 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1406 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:38:06.359744 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-a2384f21-61bb-49e8-8d45-ade3a45be75e req-819966d2-2434-4638-aaac-0f3c51379324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb58298d-9795-4c2b-86b6-3b17b668765f", "tag": "ad9b761f-8e30-4890-b16f-aceb4777ab0b"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:06.361798 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:38:06.361798 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:38:06.377408 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-a2384f21-61bb-49e8-8d45-ade3a45be75e req-819966d2-2434-4638-aaac-0f3c51379324 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:06.378603 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-a2384f21-61bb-49e8-8d45-ade3a45be75e req-819966d2-2434-4638-aaac-0f3c51379324 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:06.401945 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-b4938eb4-8d22-4d40-a96e-d51ccd06f56c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:06.404578 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-a2384f21-61bb-49e8-8d45-ade3a45be75e req-819966d2-2434-4638-aaac-0f3c51379324 service nova] Creating event network-changed:ad9b761f-8e30-4890-b16f-aceb4777ab0b for instance bb58298d-9795-4c2b-86b6-3b17b668765f on hv-cinder-maste Jan 10 11:38:06.420755 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-a2384f21-61bb-49e8-8d45-ade3a45be75e req-819966d2-2434-4638-aaac-0f3c51379324 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065670 Jan 10 11:38:06.423359 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 41/81] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:38:06.426876 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b4938eb4-8d22-4d40-a96e-d51ccd06f56c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 0.492840 Jan 10 11:38:06.436153 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-47954244-13a3-4df0-9a7a-7decb3156dcf req-d8314390-dc0f-4bd9-bd87-d78353e49082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de742531-93dd-4422-b11c-57c35a136f6e", "tag": "1402bd72-ebce-40e3-b2fe-9132d0fbe846"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:06.442551 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:38:06.442551 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:38:06.447886 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 41/82] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:05 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:06.462365 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-47954244-13a3-4df0-9a7a-7decb3156dcf req-d8314390-dc0f-4bd9-bd87-d78353e49082 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:06.465541 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-47954244-13a3-4df0-9a7a-7decb3156dcf req-d8314390-dc0f-4bd9-bd87-d78353e49082 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:06.487487 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2f5c3e78-2b37-4a75-b894-9d2e52142c52 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:06.488317 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2f5c3e78-2b37-4a75-b894-9d2e52142c52 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:06.497027 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2f5c3e78-2b37-4a75-b894-9d2e52142c52 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:06.497735 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2f5c3e78-2b37-4a75-b894-9d2e52142c52 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:06.511987 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2f5c3e78-2b37-4a75-b894-9d2e52142c52 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:06.512920 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2f5c3e78-2b37-4a75-b894-9d2e52142c52 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:06.518487 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-47954244-13a3-4df0-9a7a-7decb3156dcf req-d8314390-dc0f-4bd9-bd87-d78353e49082 service nova] Creating event network-changed:1402bd72-ebce-40e3-b2fe-9132d0fbe846 for instance de742531-93dd-4422-b11c-57c35a136f6e on hv-cinder-maste Jan 10 11:38:06.542946 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-47954244-13a3-4df0-9a7a-7decb3156dcf req-d8314390-dc0f-4bd9-bd87-d78353e49082 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109741 Jan 10 11:38:06.542946 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 42/83] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:38:06.560850 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a7cd8a47-f2e9-4e97-a424-df318721719d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:06.562532 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a7cd8a47-f2e9-4e97-a424-df318721719d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:06.573387 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a7cd8a47-f2e9-4e97-a424-df318721719d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:06.574597 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a7cd8a47-f2e9-4e97-a424-df318721719d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:06.576281 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a7cd8a47-f2e9-4e97-a424-df318721719d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:06.577524 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a7cd8a47-f2e9-4e97-a424-df318721719d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:07.350268 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2f5c3e78-2b37-4a75-b894-9d2e52142c52 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:07.369877 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2f5c3e78-2b37-4a75-b894-9d2e52142c52 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1364 microversion: 2.1 time: 0.896603 Jan 10 11:38:07.379359 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 42/84] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:06 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1364 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:07.401973 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-4ddadfa9-22b5-4625-96ce-4d0de1d88ac3 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:07.403257 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-4ddadfa9-22b5-4625-96ce-4d0de1d88ac3 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:07.411125 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-a7cd8a47-f2e9-4e97-a424-df318721719d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:07.420788 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a7cd8a47-f2e9-4e97-a424-df318721719d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1320 microversion: 2.1 time: 0.877101 Jan 10 11:38:07.426055 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 43/85] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:06 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1320 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:07.432979 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b84c7782-cacf-41a5-84d8-a42e93cc87c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:07.433779 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b84c7782-cacf-41a5-84d8-a42e93cc87c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:07.439945 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4ddadfa9-22b5-4625-96ce-4d0de1d88ac3 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:07.440678 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4ddadfa9-22b5-4625-96ce-4d0de1d88ac3 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:07.442146 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b84c7782-cacf-41a5-84d8-a42e93cc87c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:07.443112 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4ddadfa9-22b5-4625-96ce-4d0de1d88ac3 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:07.443695 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b84c7782-cacf-41a5-84d8-a42e93cc87c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:07.443807 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4ddadfa9-22b5-4625-96ce-4d0de1d88ac3 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:07.445658 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b84c7782-cacf-41a5-84d8-a42e93cc87c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:07.446394 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b84c7782-cacf-41a5-84d8-a42e93cc87c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:07.893457 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b84c7782-cacf-41a5-84d8-a42e93cc87c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:07.910801 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-4ddadfa9-22b5-4625-96ce-4d0de1d88ac3 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:07.921297 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-4ddadfa9-22b5-4625-96ce-4d0de1d88ac3 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 0.536908 Jan 10 11:38:07.925921 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 43/86] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:07 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:07.929435 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b84c7782-cacf-41a5-84d8-a42e93cc87c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:07.938020 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b84c7782-cacf-41a5-84d8-a42e93cc87c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:07.939596 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b84c7782-cacf-41a5-84d8-a42e93cc87c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1406 microversion: 2.20 time: 0.512086 Jan 10 11:38:07.940841 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-df848515-c96c-4cde-b5c4-316a76e02c48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:07.941728 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 44/87] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:07 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1406 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:38:07.942336 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-df848515-c96c-4cde-b5c4-316a76e02c48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:07.973074 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-df848515-c96c-4cde-b5c4-316a76e02c48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:07.974443 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-df848515-c96c-4cde-b5c4-316a76e02c48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:07.976113 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-df848515-c96c-4cde-b5c4-316a76e02c48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:07.977231 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-df848515-c96c-4cde-b5c4-316a76e02c48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:08.042831 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-f5794e90-4168-4a6d-bec6-202b701e30bf req-3ed41d8b-8516-4532-932b-9021e48567e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17641f31-456c-4c0f-8f40-5337b16bc6e0", "name": "network-vif-plugged", "status": "completed", "tag": "6d5c4e49-c1c6-44b3-8b26-b44d2d601cbc"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:08.045267 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:38:08.045267 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:38:08.054971 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-f5794e90-4168-4a6d-bec6-202b701e30bf req-3ed41d8b-8516-4532-932b-9021e48567e0 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:08.055667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-f5794e90-4168-4a6d-bec6-202b701e30bf req-3ed41d8b-8516-4532-932b-9021e48567e0 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:08.068759 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-f5794e90-4168-4a6d-bec6-202b701e30bf req-3ed41d8b-8516-4532-932b-9021e48567e0 service nova] Creating event network-vif-plugged:6d5c4e49-c1c6-44b3-8b26-b44d2d601cbc for instance 17641f31-456c-4c0f-8f40-5337b16bc6e0 on hv-cinder-maste Jan 10 11:38:08.074816 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-f5794e90-4168-4a6d-bec6-202b701e30bf req-3ed41d8b-8516-4532-932b-9021e48567e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130866 Jan 10 11:38:08.074996 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 45/88] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:38:08.193684 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-df848515-c96c-4cde-b5c4-316a76e02c48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:08.202240 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-df848515-c96c-4cde-b5c4-316a76e02c48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 0.274832 Jan 10 11:38:08.203308 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 44/89] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:07 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:08.397152 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-745d0db7-14aa-47bb-9bcd-4762af4bee6d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:08.398672 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-745d0db7-14aa-47bb-9bcd-4762af4bee6d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:08.405290 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-745d0db7-14aa-47bb-9bcd-4762af4bee6d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:08.405737 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-745d0db7-14aa-47bb-9bcd-4762af4bee6d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:08.406566 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-745d0db7-14aa-47bb-9bcd-4762af4bee6d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:08.407134 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-745d0db7-14aa-47bb-9bcd-4762af4bee6d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:08.450833 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-1c2729e5-0907-4112-af58-34c0cc4858d3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:08.451557 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-1c2729e5-0907-4112-af58-34c0cc4858d3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:08.460208 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1c2729e5-0907-4112-af58-34c0cc4858d3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:08.461088 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1c2729e5-0907-4112-af58-34c0cc4858d3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:08.462054 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1c2729e5-0907-4112-af58-34c0cc4858d3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:08.462607 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1c2729e5-0907-4112-af58-34c0cc4858d3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:08.666455 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-745d0db7-14aa-47bb-9bcd-4762af4bee6d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:08.673826 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-745d0db7-14aa-47bb-9bcd-4762af4bee6d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1364 microversion: 2.1 time: 0.283933 Jan 10 11:38:08.674437 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 46/90] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:08 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:08.693510 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-1c2729e5-0907-4112-af58-34c0cc4858d3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:08.701660 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-1c2729e5-0907-4112-af58-34c0cc4858d3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1320 microversion: 2.1 time: 0.255284 Jan 10 11:38:08.702562 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 45/91] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:08 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1320 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:08.941863 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-dc22480a-5f1d-43c7-9b6f-0faf4f3aa4e2 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:08.942432 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-dc22480a-5f1d-43c7-9b6f-0faf4f3aa4e2 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:08.949134 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dc22480a-5f1d-43c7-9b6f-0faf4f3aa4e2 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:08.949586 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dc22480a-5f1d-43c7-9b6f-0faf4f3aa4e2 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:08.950472 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dc22480a-5f1d-43c7-9b6f-0faf4f3aa4e2 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:08.950908 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dc22480a-5f1d-43c7-9b6f-0faf4f3aa4e2 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:08.958960 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a94eb7fc-db3f-4307-9d3a-780efc4205ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:08.979250 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a94eb7fc-db3f-4307-9d3a-780efc4205ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:08.979250 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a94eb7fc-db3f-4307-9d3a-780efc4205ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:08.979250 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a94eb7fc-db3f-4307-9d3a-780efc4205ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:08.979250 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a94eb7fc-db3f-4307-9d3a-780efc4205ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:08.979623 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a94eb7fc-db3f-4307-9d3a-780efc4205ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:09.154461 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-dc22480a-5f1d-43c7-9b6f-0faf4f3aa4e2 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:09.162519 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-dc22480a-5f1d-43c7-9b6f-0faf4f3aa4e2 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 0.224287 Jan 10 11:38:09.163266 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a94eb7fc-db3f-4307-9d3a-780efc4205ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:09.163633 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 47/92] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:08 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:09.171813 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a94eb7fc-db3f-4307-9d3a-780efc4205ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:09.173452 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a94eb7fc-db3f-4307-9d3a-780efc4205ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:09.174883 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a94eb7fc-db3f-4307-9d3a-780efc4205ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1406 microversion: 2.20 time: 0.219564 Jan 10 11:38:09.175473 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 46/93] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:08 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:38:09.230611 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b7b1bcc2-152e-45b2-aedc-d5c8e23b8ff8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:09.231536 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b7b1bcc2-152e-45b2-aedc-d5c8e23b8ff8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:09.238073 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b7b1bcc2-152e-45b2-aedc-d5c8e23b8ff8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:09.238663 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b7b1bcc2-152e-45b2-aedc-d5c8e23b8ff8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:09.239577 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b7b1bcc2-152e-45b2-aedc-d5c8e23b8ff8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:09.240192 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b7b1bcc2-152e-45b2-aedc-d5c8e23b8ff8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:09.377020 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b7b1bcc2-152e-45b2-aedc-d5c8e23b8ff8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:09.384384 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b7b1bcc2-152e-45b2-aedc-d5c8e23b8ff8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 0.158910 Jan 10 11:38:09.384958 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 48/94] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:09 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:09.691089 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7690dac5-db0a-4ef8-a8e9-9ca47f1fe2da tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:09.691592 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7690dac5-db0a-4ef8-a8e9-9ca47f1fe2da tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:09.698300 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7690dac5-db0a-4ef8-a8e9-9ca47f1fe2da tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:09.698759 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7690dac5-db0a-4ef8-a8e9-9ca47f1fe2da tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:09.699535 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7690dac5-db0a-4ef8-a8e9-9ca47f1fe2da tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:09.699962 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7690dac5-db0a-4ef8-a8e9-9ca47f1fe2da tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:09.719577 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4ddd7f60-be84-4bcc-a9cb-2b3dc6b51e97 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:09.720392 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4ddd7f60-be84-4bcc-a9cb-2b3dc6b51e97 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:09.727547 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4ddd7f60-be84-4bcc-a9cb-2b3dc6b51e97 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:09.728001 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4ddd7f60-be84-4bcc-a9cb-2b3dc6b51e97 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:09.728807 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4ddd7f60-be84-4bcc-a9cb-2b3dc6b51e97 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:09.729255 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4ddd7f60-be84-4bcc-a9cb-2b3dc6b51e97 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:09.905815 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-7690dac5-db0a-4ef8-a8e9-9ca47f1fe2da tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:09.913802 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7690dac5-db0a-4ef8-a8e9-9ca47f1fe2da tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1364 microversion: 2.1 time: 0.226369 Jan 10 11:38:09.913963 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4ddd7f60-be84-4bcc-a9cb-2b3dc6b51e97 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:09.914421 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 47/95] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:09 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:09.921417 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4ddd7f60-be84-4bcc-a9cb-2b3dc6b51e97 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1320 microversion: 2.1 time: 0.205602 Jan 10 11:38:09.922334 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 49/96] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:09 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1320 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:10.094159 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-92723c8b-b95d-4a8f-8d42-d671fdcbecb9 req-f3070cd8-938e-419a-a3c7-04c4b15d73ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb75a87-2b05-43d3-b570-a04858874b50", "name": "network-vif-plugged", "status": "completed", "tag": "94a56965-edf5-4d72-b69a-a0f3ecd10498"}, {"server_uuid": "6353ce19-8a0e-4424-ab1f-d6e822696c00", "name": "network-vif-plugged", "status": "completed", "tag": "0ea7b088-85a0-4b99-b5b6-5915fac5b55a"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:10.095886 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:38:10.095886 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:38:10.103563 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-92723c8b-b95d-4a8f-8d42-d671fdcbecb9 req-f3070cd8-938e-419a-a3c7-04c4b15d73ec service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:10.104008 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-92723c8b-b95d-4a8f-8d42-d671fdcbecb9 req-f3070cd8-938e-419a-a3c7-04c4b15d73ec service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:10.116305 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-92723c8b-b95d-4a8f-8d42-d671fdcbecb9 req-f3070cd8-938e-419a-a3c7-04c4b15d73ec service nova] Creating event network-vif-plugged:94a56965-edf5-4d72-b69a-a0f3ecd10498 for instance 9bb75a87-2b05-43d3-b570-a04858874b50 on hv-cinder-maste Jan 10 11:38:10.116853 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-92723c8b-b95d-4a8f-8d42-d671fdcbecb9 req-f3070cd8-938e-419a-a3c7-04c4b15d73ec service nova] Creating event network-vif-plugged:0ea7b088-85a0-4b99-b5b6-5915fac5b55a for instance 6353ce19-8a0e-4424-ab1f-d6e822696c00 on hv-cinder-maste Jan 10 11:38:10.123066 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-92723c8b-b95d-4a8f-8d42-d671fdcbecb9 req-f3070cd8-938e-419a-a3c7-04c4b15d73ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032535 Jan 10 11:38:10.123637 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 48/97] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:38:10.180441 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c9700b73-e810-4647-83b5-4e2939fc7a0f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:10.181041 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c9700b73-e810-4647-83b5-4e2939fc7a0f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:10.187185 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c9700b73-e810-4647-83b5-4e2939fc7a0f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:10.187646 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c9700b73-e810-4647-83b5-4e2939fc7a0f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:10.188438 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c9700b73-e810-4647-83b5-4e2939fc7a0f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:10.189142 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c9700b73-e810-4647-83b5-4e2939fc7a0f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:10.196901 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-50229142-da84-44d4-99c3-a951f60a0563 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:10.198079 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-50229142-da84-44d4-99c3-a951f60a0563 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:10.207847 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-50229142-da84-44d4-99c3-a951f60a0563 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:10.208606 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-50229142-da84-44d4-99c3-a951f60a0563 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:10.210261 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-50229142-da84-44d4-99c3-a951f60a0563 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:10.210977 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-50229142-da84-44d4-99c3-a951f60a0563 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:10.405147 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c9700b73-e810-4647-83b5-4e2939fc7a0f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:10.409276 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-50229142-da84-44d4-99c3-a951f60a0563 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:10.413711 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c9700b73-e810-4647-83b5-4e2939fc7a0f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 0.236509 Jan 10 11:38:10.414488 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 50/98] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:10 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:10.418364 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-50229142-da84-44d4-99c3-a951f60a0563 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:10.419605 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f86d281a-b279-4119-ad28-11d04363c83d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:10.419899 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-50229142-da84-44d4-99c3-a951f60a0563 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:10.420206 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f86d281a-b279-4119-ad28-11d04363c83d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:10.421020 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-50229142-da84-44d4-99c3-a951f60a0563 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1406 microversion: 2.20 time: 0.230649 Jan 10 11:38:10.425589 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 49/99] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:10 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:38:10.430773 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f86d281a-b279-4119-ad28-11d04363c83d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:10.431227 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f86d281a-b279-4119-ad28-11d04363c83d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:10.432024 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f86d281a-b279-4119-ad28-11d04363c83d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:10.432459 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f86d281a-b279-4119-ad28-11d04363c83d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:10.567067 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f86d281a-b279-4119-ad28-11d04363c83d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:10.575159 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f86d281a-b279-4119-ad28-11d04363c83d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 0.159468 Jan 10 11:38:10.575743 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 51/100] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:10 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:10.931775 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-429c6fc2-bfbe-4498-91e6-0eb028052fd0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:10.932571 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-429c6fc2-bfbe-4498-91e6-0eb028052fd0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:10.939163 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-429c6fc2-bfbe-4498-91e6-0eb028052fd0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:10.939967 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-429c6fc2-bfbe-4498-91e6-0eb028052fd0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:10.940588 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7148e00d-5b5e-4de0-b060-ba91e4e9e0ba tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:10.941055 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-429c6fc2-bfbe-4498-91e6-0eb028052fd0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:10.941261 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7148e00d-5b5e-4de0-b060-ba91e4e9e0ba tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:10.941578 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-429c6fc2-bfbe-4498-91e6-0eb028052fd0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:10.949469 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7148e00d-5b5e-4de0-b060-ba91e4e9e0ba tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:10.952834 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7148e00d-5b5e-4de0-b060-ba91e4e9e0ba tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:10.965263 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7148e00d-5b5e-4de0-b060-ba91e4e9e0ba tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:10.965263 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7148e00d-5b5e-4de0-b060-ba91e4e9e0ba tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:11.168191 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-429c6fc2-bfbe-4498-91e6-0eb028052fd0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:11.175687 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-429c6fc2-bfbe-4498-91e6-0eb028052fd0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1364 microversion: 2.1 time: 0.248642 Jan 10 11:38:11.176071 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7148e00d-5b5e-4de0-b060-ba91e4e9e0ba tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:11.176905 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 50/101] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:10 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:11.189583 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7148e00d-5b5e-4de0-b060-ba91e4e9e0ba tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1320 microversion: 2.1 time: 0.253482 Jan 10 11:38:11.190682 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 52/102] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:10 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1320 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:11.430886 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-0a5c6508-d04c-40e3-9862-08b68dfedd4d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:11.431490 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-0a5c6508-d04c-40e3-9862-08b68dfedd4d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:11.437485 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0a5c6508-d04c-40e3-9862-08b68dfedd4d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:11.437934 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0a5c6508-d04c-40e3-9862-08b68dfedd4d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:11.438755 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0a5c6508-d04c-40e3-9862-08b68dfedd4d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:11.439188 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0a5c6508-d04c-40e3-9862-08b68dfedd4d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:11.439325 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-bdc5856c-54f0-426b-851f-81e7a18efe0e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:11.439884 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-bdc5856c-54f0-426b-851f-81e7a18efe0e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:11.446341 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bdc5856c-54f0-426b-851f-81e7a18efe0e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:11.446800 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bdc5856c-54f0-426b-851f-81e7a18efe0e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:11.447584 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bdc5856c-54f0-426b-851f-81e7a18efe0e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:11.448029 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bdc5856c-54f0-426b-851f-81e7a18efe0e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:11.644134 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-0a5c6508-d04c-40e3-9862-08b68dfedd4d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:11.652265 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-0a5c6508-d04c-40e3-9862-08b68dfedd4d tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 0.225054 Jan 10 11:38:11.652999 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-bdc5856c-54f0-426b-851f-81e7a18efe0e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:11.653125 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 51/103] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:11 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:11.657262 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2c83f21e-b3c5-42a6-9861-2a730ade346e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:11.657730 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2c83f21e-b3c5-42a6-9861-2a730ade346e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:11.661210 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-bdc5856c-54f0-426b-851f-81e7a18efe0e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:11.662692 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-bdc5856c-54f0-426b-851f-81e7a18efe0e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:11.663849 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2c83f21e-b3c5-42a6-9861-2a730ade346e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:11.663971 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-bdc5856c-54f0-426b-851f-81e7a18efe0e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1406 microversion: 2.20 time: 0.228428 Jan 10 11:38:11.664303 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2c83f21e-b3c5-42a6-9861-2a730ade346e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:11.664421 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 53/104] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:11 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:38:11.665097 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2c83f21e-b3c5-42a6-9861-2a730ade346e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:11.665532 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2c83f21e-b3c5-42a6-9861-2a730ade346e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:11.805362 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2c83f21e-b3c5-42a6-9861-2a730ade346e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:11.813087 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2c83f21e-b3c5-42a6-9861-2a730ade346e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 0.159249 Jan 10 11:38:11.813664 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 52/105] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:11 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:12.200588 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0275abac-07c7-4aaf-8610-5bd1ecbe9f95 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:12.201237 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0275abac-07c7-4aaf-8610-5bd1ecbe9f95 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:12.206084 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-4574ba51-a938-4e4a-98e7-d307e5432354 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:12.206887 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-4574ba51-a938-4e4a-98e7-d307e5432354 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:12.207294 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0275abac-07c7-4aaf-8610-5bd1ecbe9f95 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:12.207753 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0275abac-07c7-4aaf-8610-5bd1ecbe9f95 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:12.208541 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0275abac-07c7-4aaf-8610-5bd1ecbe9f95 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:12.208982 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0275abac-07c7-4aaf-8610-5bd1ecbe9f95 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:12.213312 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4574ba51-a938-4e4a-98e7-d307e5432354 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:12.213767 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4574ba51-a938-4e4a-98e7-d307e5432354 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:12.214604 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4574ba51-a938-4e4a-98e7-d307e5432354 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:12.215044 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4574ba51-a938-4e4a-98e7-d307e5432354 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:12.409785 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-4574ba51-a938-4e4a-98e7-d307e5432354 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:12.414085 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0275abac-07c7-4aaf-8610-5bd1ecbe9f95 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:12.418183 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-4574ba51-a938-4e4a-98e7-d307e5432354 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1320 microversion: 2.1 time: 0.215633 Jan 10 11:38:12.418874 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 53/106] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:12 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1320 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:12.422016 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0275abac-07c7-4aaf-8610-5bd1ecbe9f95 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1364 microversion: 2.1 time: 0.225059 Jan 10 11:38:12.422606 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 54/107] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:12 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:12.669358 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-1f0b5ec3-6093-41d4-8ded-8ace4191b02c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:12.670066 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-1f0b5ec3-6093-41d4-8ded-8ace4191b02c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:12.676120 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1f0b5ec3-6093-41d4-8ded-8ace4191b02c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:12.676579 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1f0b5ec3-6093-41d4-8ded-8ace4191b02c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:12.677373 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1f0b5ec3-6093-41d4-8ded-8ace4191b02c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:12.677814 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1f0b5ec3-6093-41d4-8ded-8ace4191b02c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:12.682205 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-50f3a83a-6d94-4f32-ab08-fae587e2d387 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:12.683025 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-50f3a83a-6d94-4f32-ab08-fae587e2d387 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:12.688762 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-50f3a83a-6d94-4f32-ab08-fae587e2d387 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:12.689218 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-50f3a83a-6d94-4f32-ab08-fae587e2d387 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:12.690008 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-50f3a83a-6d94-4f32-ab08-fae587e2d387 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:12.690473 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-50f3a83a-6d94-4f32-ab08-fae587e2d387 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:12.865087 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-1f0b5ec3-6093-41d4-8ded-8ace4191b02c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:12.873504 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-1f0b5ec3-6093-41d4-8ded-8ace4191b02c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 0.207726 Jan 10 11:38:12.874228 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 54/108] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:12 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:12.878713 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-4ef21f21-d296-4716-94d6-1d14c108c250 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:12.879329 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-4ef21f21-d296-4716-94d6-1d14c108c250 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:12.886095 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4ef21f21-d296-4716-94d6-1d14c108c250 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:12.886578 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4ef21f21-d296-4716-94d6-1d14c108c250 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:12.887364 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4ef21f21-d296-4716-94d6-1d14c108c250 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:12.887797 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4ef21f21-d296-4716-94d6-1d14c108c250 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:12.892004 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-50f3a83a-6d94-4f32-ab08-fae587e2d387 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:12.901133 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-50f3a83a-6d94-4f32-ab08-fae587e2d387 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:12.902897 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-50f3a83a-6d94-4f32-ab08-fae587e2d387 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:12.904175 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-50f3a83a-6d94-4f32-ab08-fae587e2d387 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1406 microversion: 2.20 time: 0.226403 Jan 10 11:38:12.904847 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 55/109] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:12 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:38:13.031210 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-4ef21f21-d296-4716-94d6-1d14c108c250 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:13.038723 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-4ef21f21-d296-4716-94d6-1d14c108c250 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 0.163471 Jan 10 11:38:13.039313 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 55/110] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:12 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:13.435138 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-56ae0b06-aae9-4e0f-b438-9fd459d8a3e6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:13.435703 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-56ae0b06-aae9-4e0f-b438-9fd459d8a3e6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:13.438689 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b99049fd-4384-4aa8-800f-0dd2d9861b5e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:13.439306 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b99049fd-4384-4aa8-800f-0dd2d9861b5e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:13.442027 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-56ae0b06-aae9-4e0f-b438-9fd459d8a3e6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:13.442513 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-56ae0b06-aae9-4e0f-b438-9fd459d8a3e6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:13.443295 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-56ae0b06-aae9-4e0f-b438-9fd459d8a3e6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:13.443728 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-56ae0b06-aae9-4e0f-b438-9fd459d8a3e6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:13.445788 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b99049fd-4384-4aa8-800f-0dd2d9861b5e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:13.446272 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b99049fd-4384-4aa8-800f-0dd2d9861b5e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:13.447096 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b99049fd-4384-4aa8-800f-0dd2d9861b5e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:13.447534 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b99049fd-4384-4aa8-800f-0dd2d9861b5e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:13.641729 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-b99049fd-4384-4aa8-800f-0dd2d9861b5e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:13.646547 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-56ae0b06-aae9-4e0f-b438-9fd459d8a3e6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:13.650544 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b99049fd-4384-4aa8-800f-0dd2d9861b5e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1364 microversion: 2.1 time: 0.215497 Jan 10 11:38:13.651170 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 56/111] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:13 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:13.656165 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-56ae0b06-aae9-4e0f-b438-9fd459d8a3e6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1320 microversion: 2.1 time: 0.224938 Jan 10 11:38:13.657079 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 56/112] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:13 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1320 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:13.891133 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5c040cf3-cfeb-4c7d-a8df-cf1d247585d0 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:13.891755 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5c040cf3-cfeb-4c7d-a8df-cf1d247585d0 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:13.898445 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5c040cf3-cfeb-4c7d-a8df-cf1d247585d0 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:13.898930 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5c040cf3-cfeb-4c7d-a8df-cf1d247585d0 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:13.899730 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5c040cf3-cfeb-4c7d-a8df-cf1d247585d0 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:13.900183 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5c040cf3-cfeb-4c7d-a8df-cf1d247585d0 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:13.922102 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-024e4df9-0a30-4a82-aaa0-b0442a164037 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:13.922675 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-024e4df9-0a30-4a82-aaa0-b0442a164037 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:13.929858 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-024e4df9-0a30-4a82-aaa0-b0442a164037 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:13.930530 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-024e4df9-0a30-4a82-aaa0-b0442a164037 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:13.931397 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-024e4df9-0a30-4a82-aaa0-b0442a164037 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:13.931992 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-024e4df9-0a30-4a82-aaa0-b0442a164037 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:14.134045 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-024e4df9-0a30-4a82-aaa0-b0442a164037 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:14.136750 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5c040cf3-cfeb-4c7d-a8df-cf1d247585d0 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:14.142309 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-024e4df9-0a30-4a82-aaa0-b0442a164037 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:14.144096 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-024e4df9-0a30-4a82-aaa0-b0442a164037 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:14.145222 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-024e4df9-0a30-4a82-aaa0-b0442a164037 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1406 microversion: 2.20 time: 0.226990 Jan 10 11:38:14.145722 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5c040cf3-cfeb-4c7d-a8df-cf1d247585d0 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 0.258115 Jan 10 11:38:14.145845 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 57/113] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:13 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:38:14.146560 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 57/114] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:13 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:14.160876 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-344685d2-5614-40e5-96e2-d165b3e25d3d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:14.161487 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-344685d2-5614-40e5-96e2-d165b3e25d3d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:14.167818 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-344685d2-5614-40e5-96e2-d165b3e25d3d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:14.168042 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-344685d2-5614-40e5-96e2-d165b3e25d3d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:14.168929 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-344685d2-5614-40e5-96e2-d165b3e25d3d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:14.169367 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-344685d2-5614-40e5-96e2-d165b3e25d3d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:14.304098 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-344685d2-5614-40e5-96e2-d165b3e25d3d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:14.311679 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-344685d2-5614-40e5-96e2-d165b3e25d3d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 0.155813 Jan 10 11:38:14.312237 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 58/115] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:14 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:14.667529 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-247103ab-d0ab-4a82-b0ab-e2538c585f62 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:14.668997 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-247103ab-d0ab-4a82-b0ab-e2538c585f62 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:14.676901 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-cf0f274d-2aec-4ec2-b3c6-ae1890c14ecb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:14.678050 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-cf0f274d-2aec-4ec2-b3c6-ae1890c14ecb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:14.689730 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-247103ab-d0ab-4a82-b0ab-e2538c585f62 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:14.690017 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cf0f274d-2aec-4ec2-b3c6-ae1890c14ecb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:14.690248 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-247103ab-d0ab-4a82-b0ab-e2538c585f62 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:14.690816 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cf0f274d-2aec-4ec2-b3c6-ae1890c14ecb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:14.690992 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-247103ab-d0ab-4a82-b0ab-e2538c585f62 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:14.691431 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-247103ab-d0ab-4a82-b0ab-e2538c585f62 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:14.691626 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cf0f274d-2aec-4ec2-b3c6-ae1890c14ecb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:14.692075 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cf0f274d-2aec-4ec2-b3c6-ae1890c14ecb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:15.101579 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-247103ab-d0ab-4a82-b0ab-e2538c585f62 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:15.109534 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-247103ab-d0ab-4a82-b0ab-e2538c585f62 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1364 microversion: 2.1 time: 0.445690 Jan 10 11:38:15.110121 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 58/116] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:14 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1364 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:15.114504 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-a91a1310-da3a-43d3-ae12-303b11e9ad4e req-3e1797e5-3874-4d66-8e22-30cdfe83f1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da86e35-89e4-462a-bac2-19a859b044ef", "name": "network-vif-plugged", "status": "completed", "tag": "78489ff4-6ec9-4d77-ad90-108d911867f2"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:15.116772 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:38:15.116772 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:38:15.118110 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-cf0f274d-2aec-4ec2-b3c6-ae1890c14ecb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:15.124264 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-a91a1310-da3a-43d3-ae12-303b11e9ad4e req-3e1797e5-3874-4d66-8e22-30cdfe83f1e5 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:15.124713 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-a91a1310-da3a-43d3-ae12-303b11e9ad4e req-3e1797e5-3874-4d66-8e22-30cdfe83f1e5 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:15.125972 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-cf0f274d-2aec-4ec2-b3c6-ae1890c14ecb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1320 microversion: 2.1 time: 0.455671 Jan 10 11:38:15.126693 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 59/117] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:14 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1320 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:15.136265 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-a91a1310-da3a-43d3-ae12-303b11e9ad4e req-3e1797e5-3874-4d66-8e22-30cdfe83f1e5 service nova] Creating event network-vif-plugged:78489ff4-6ec9-4d77-ad90-108d911867f2 for instance 1da86e35-89e4-462a-bac2-19a859b044ef on hv-cinder-maste Jan 10 11:38:15.141245 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-a91a1310-da3a-43d3-ae12-303b11e9ad4e req-3e1797e5-3874-4d66-8e22-30cdfe83f1e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029936 Jan 10 11:38:15.141878 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 59/118] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:38:15.163797 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3c820659-3b05-4f54-96dc-3c531c0f63ec tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:15.163935 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-50867ce2-c321-4a66-96e5-f757537849be tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:15.164558 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-50867ce2-c321-4a66-96e5-f757537849be tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:15.165093 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3c820659-3b05-4f54-96dc-3c531c0f63ec tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:15.171726 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3c820659-3b05-4f54-96dc-3c531c0f63ec tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:15.172322 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3c820659-3b05-4f54-96dc-3c531c0f63ec tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:15.173158 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-50867ce2-c321-4a66-96e5-f757537849be tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:15.173948 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3c820659-3b05-4f54-96dc-3c531c0f63ec tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:15.174133 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-50867ce2-c321-4a66-96e5-f757537849be tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:15.174620 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3c820659-3b05-4f54-96dc-3c531c0f63ec tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:15.175622 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-50867ce2-c321-4a66-96e5-f757537849be tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:15.176264 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-50867ce2-c321-4a66-96e5-f757537849be tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:15.419572 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3c820659-3b05-4f54-96dc-3c531c0f63ec tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:15.427439 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3c820659-3b05-4f54-96dc-3c531c0f63ec tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 0.268483 Jan 10 11:38:15.428970 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 60/119] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:15 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:15.434729 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-fb22e83c-a0ee-48c8-9ce8-fd1658ad37a8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:15.435574 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-fb22e83c-a0ee-48c8-9ce8-fd1658ad37a8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:15.443671 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fb22e83c-a0ee-48c8-9ce8-fd1658ad37a8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:15.444803 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fb22e83c-a0ee-48c8-9ce8-fd1658ad37a8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:15.451610 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fb22e83c-a0ee-48c8-9ce8-fd1658ad37a8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:15.451610 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fb22e83c-a0ee-48c8-9ce8-fd1658ad37a8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:15.451886 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-50867ce2-c321-4a66-96e5-f757537849be tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:15.461254 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-50867ce2-c321-4a66-96e5-f757537849be tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:15.462831 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-50867ce2-c321-4a66-96e5-f757537849be tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:15.463989 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-50867ce2-c321-4a66-96e5-f757537849be tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1406 microversion: 2.20 time: 0.304369 Jan 10 11:38:15.469146 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 60/120] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:15 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1406 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:38:15.592947 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-fb22e83c-a0ee-48c8-9ce8-fd1658ad37a8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:15.600398 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-fb22e83c-a0ee-48c8-9ce8-fd1658ad37a8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1317 microversion: 2.1 time: 0.169903 Jan 10 11:38:15.611000 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 61/121] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:15 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:16.127689 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e9ae0802-7948-410c-b296-af77de10039a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:16.128197 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-e9ae0802-7948-410c-b296-af77de10039a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:16.134638 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e9ae0802-7948-410c-b296-af77de10039a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:16.135090 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e9ae0802-7948-410c-b296-af77de10039a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:16.135873 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e9ae0802-7948-410c-b296-af77de10039a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:16.136301 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e9ae0802-7948-410c-b296-af77de10039a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:16.144018 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7d36f1bb-964e-47d4-8a32-38114f46791f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:16.144488 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7d36f1bb-964e-47d4-8a32-38114f46791f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:16.151290 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7d36f1bb-964e-47d4-8a32-38114f46791f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:16.151752 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7d36f1bb-964e-47d4-8a32-38114f46791f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:16.152554 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7d36f1bb-964e-47d4-8a32-38114f46791f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:16.153030 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7d36f1bb-964e-47d4-8a32-38114f46791f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:16.346020 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-e9ae0802-7948-410c-b296-af77de10039a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:16.360265 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-e9ae0802-7948-410c-b296-af77de10039a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1364 microversion: 2.1 time: 0.236212 Jan 10 11:38:16.360856 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 61/122] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:16 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:16.363279 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7d36f1bb-964e-47d4-8a32-38114f46791f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:16.370616 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7d36f1bb-964e-47d4-8a32-38114f46791f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1320 microversion: 2.1 time: 0.230623 Jan 10 11:38:16.373108 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 62/123] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:16 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1320 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:16.452635 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-4f1138ea-9d74-4649-82c0-95b405f6de15 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:16.453331 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-4f1138ea-9d74-4649-82c0-95b405f6de15 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:16.459461 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4f1138ea-9d74-4649-82c0-95b405f6de15 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:16.460551 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4f1138ea-9d74-4649-82c0-95b405f6de15 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:16.461428 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4f1138ea-9d74-4649-82c0-95b405f6de15 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:16.462048 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4f1138ea-9d74-4649-82c0-95b405f6de15 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:16.492156 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c9d05dee-dca8-4d89-bfef-20bb0a4bc306 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:16.493362 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c9d05dee-dca8-4d89-bfef-20bb0a4bc306 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:16.500350 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c9d05dee-dca8-4d89-bfef-20bb0a4bc306 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:16.501031 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c9d05dee-dca8-4d89-bfef-20bb0a4bc306 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:16.502026 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c9d05dee-dca8-4d89-bfef-20bb0a4bc306 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:16.502658 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c9d05dee-dca8-4d89-bfef-20bb0a4bc306 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:16.667078 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-4f1138ea-9d74-4649-82c0-95b405f6de15 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:16.682241 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-4f1138ea-9d74-4649-82c0-95b405f6de15 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1315 microversion: 2.1 time: 0.232552 Jan 10 11:38:16.691096 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 62/124] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:16 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:16.691326 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-c8d1ab3d-328f-48fb-b7b8-a8e263c732fb tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:16.692310 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-c8d1ab3d-328f-48fb-b7b8-a8e263c732fb tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:16.697391 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c9d05dee-dca8-4d89-bfef-20bb0a4bc306 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:16.709515 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c9d05dee-dca8-4d89-bfef-20bb0a4bc306 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:16.720889 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c9d05dee-dca8-4d89-bfef-20bb0a4bc306 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:16.722904 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c9d05dee-dca8-4d89-bfef-20bb0a4bc306 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1406 microversion: 2.20 time: 0.234537 Jan 10 11:38:16.723382 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c8d1ab3d-328f-48fb-b7b8-a8e263c732fb tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:16.724773 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c8d1ab3d-328f-48fb-b7b8-a8e263c732fb tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:16.728240 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c8d1ab3d-328f-48fb-b7b8-a8e263c732fb tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:16.728240 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c8d1ab3d-328f-48fb-b7b8-a8e263c732fb tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:16.740310 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 63/125] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:16 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:38:16.943269 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-c8d1ab3d-328f-48fb-b7b8-a8e263c732fb tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:16.953380 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-c8d1ab3d-328f-48fb-b7b8-a8e263c732fb tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1506 microversion: 2.1 time: 0.268053 Jan 10 11:38:16.965616 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 63/126] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:16 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:17.377703 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-38a62822-bc60-40b2-bb30-a407d40b8bee tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:17.378452 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-38a62822-bc60-40b2-bb30-a407d40b8bee tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:17.384766 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-38a62822-bc60-40b2-bb30-a407d40b8bee tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:17.385187 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-38a62822-bc60-40b2-bb30-a407d40b8bee tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:17.386155 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-38a62822-bc60-40b2-bb30-a407d40b8bee tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:17.386628 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-38a62822-bc60-40b2-bb30-a407d40b8bee tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:17.387876 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2a042213-a4cd-4fc7-97e6-72af7a67219c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:17.388489 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2a042213-a4cd-4fc7-97e6-72af7a67219c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:17.394481 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a042213-a4cd-4fc7-97e6-72af7a67219c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:17.394917 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a042213-a4cd-4fc7-97e6-72af7a67219c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:17.395707 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a042213-a4cd-4fc7-97e6-72af7a67219c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:17.396173 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a042213-a4cd-4fc7-97e6-72af7a67219c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:17.683284 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-38a62822-bc60-40b2-bb30-a407d40b8bee tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:17.694518 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-38a62822-bc60-40b2-bb30-a407d40b8bee tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1364 microversion: 2.1 time: 0.320401 Jan 10 11:38:17.695267 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 64/127] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:17 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1364 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:17.700125 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0f404ae6-1cfe-4e4b-b07e-cd8a55c95bae tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:17.701856 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0f404ae6-1cfe-4e4b-b07e-cd8a55c95bae tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:17.709187 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0f404ae6-1cfe-4e4b-b07e-cd8a55c95bae tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:17.710857 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0f404ae6-1cfe-4e4b-b07e-cd8a55c95bae tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:17.711679 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0f404ae6-1cfe-4e4b-b07e-cd8a55c95bae tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:17.712114 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0f404ae6-1cfe-4e4b-b07e-cd8a55c95bae tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:17.714994 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2a042213-a4cd-4fc7-97e6-72af7a67219c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:17.732603 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2a042213-a4cd-4fc7-97e6-72af7a67219c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1320 microversion: 2.1 time: 0.348482 Jan 10 11:38:17.742985 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 64/128] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:17 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1320 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:17.748168 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a859452f-e022-4a5a-b6b5-b8e95d00a7c4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:17.749460 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a859452f-e022-4a5a-b6b5-b8e95d00a7c4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:17.759640 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a859452f-e022-4a5a-b6b5-b8e95d00a7c4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:17.760477 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a859452f-e022-4a5a-b6b5-b8e95d00a7c4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:17.761801 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a859452f-e022-4a5a-b6b5-b8e95d00a7c4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:17.762645 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a859452f-e022-4a5a-b6b5-b8e95d00a7c4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:17.922830 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0f404ae6-1cfe-4e4b-b07e-cd8a55c95bae tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:17.939727 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0f404ae6-1cfe-4e4b-b07e-cd8a55c95bae tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1502 microversion: 2.1 time: 0.242478 Jan 10 11:38:17.940760 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 65/129] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:17 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1502 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:18.020564 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a859452f-e022-4a5a-b6b5-b8e95d00a7c4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:18.030645 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a859452f-e022-4a5a-b6b5-b8e95d00a7c4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:18.040081 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a859452f-e022-4a5a-b6b5-b8e95d00a7c4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:18.042674 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a859452f-e022-4a5a-b6b5-b8e95d00a7c4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1406 microversion: 2.20 time: 0.298343 Jan 10 11:38:18.044428 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 65/130] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:17 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:38:18.728134 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4e528ee6-a5d2-4393-8c21-daae9094b640 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:18.728742 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4e528ee6-a5d2-4393-8c21-daae9094b640 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:18.735272 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4e528ee6-a5d2-4393-8c21-daae9094b640 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:18.735713 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4e528ee6-a5d2-4393-8c21-daae9094b640 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:18.736493 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4e528ee6-a5d2-4393-8c21-daae9094b640 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:18.736926 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4e528ee6-a5d2-4393-8c21-daae9094b640 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:18.753600 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-cff38b2a-8d49-4853-86a2-47f94bea00bd tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:18.754947 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-cff38b2a-8d49-4853-86a2-47f94bea00bd tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:18.764287 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cff38b2a-8d49-4853-86a2-47f94bea00bd tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:18.765025 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cff38b2a-8d49-4853-86a2-47f94bea00bd tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:18.766367 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cff38b2a-8d49-4853-86a2-47f94bea00bd tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:18.767084 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cff38b2a-8d49-4853-86a2-47f94bea00bd tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:18.998045 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4e528ee6-a5d2-4393-8c21-daae9094b640 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:19.002756 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-cff38b2a-8d49-4853-86a2-47f94bea00bd tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:19.006798 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4e528ee6-a5d2-4393-8c21-daae9094b640 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1364 microversion: 2.1 time: 0.282654 Jan 10 11:38:19.007685 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 66/131] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:18 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:19.017938 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-cff38b2a-8d49-4853-86a2-47f94bea00bd tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1513 microversion: 2.1 time: 0.271043 Jan 10 11:38:19.019045 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 66/132] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:18 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:19.040284 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-fa856d7c-3138-4643-b316-8d4cc7576ba3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:19.041266 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-fa856d7c-3138-4643-b316-8d4cc7576ba3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:19.047365 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fa856d7c-3138-4643-b316-8d4cc7576ba3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:19.047822 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fa856d7c-3138-4643-b316-8d4cc7576ba3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:19.057488 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fa856d7c-3138-4643-b316-8d4cc7576ba3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:19.057941 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fa856d7c-3138-4643-b316-8d4cc7576ba3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:19.076508 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b99872e9-f2c6-4fa4-9eaf-a2fade598333 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:19.077173 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b99872e9-f2c6-4fa4-9eaf-a2fade598333 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:19.088856 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b99872e9-f2c6-4fa4-9eaf-a2fade598333 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:19.089431 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b99872e9-f2c6-4fa4-9eaf-a2fade598333 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:19.090348 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b99872e9-f2c6-4fa4-9eaf-a2fade598333 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:19.090853 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b99872e9-f2c6-4fa4-9eaf-a2fade598333 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:19.123931 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.objects.instance [None req-fa856d7c-3138-4643-b316-8d4cc7576ba3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lazy-loading 'flavor' on Instance uuid 1da86e35-89e4-462a-bac2-19a859b044ef {{(pid=128718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:38:19.285162 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-b99872e9-f2c6-4fa4-9eaf-a2fade598333 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:19.295188 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-b99872e9-f2c6-4fa4-9eaf-a2fade598333 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:19.296740 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-b99872e9-f2c6-4fa4-9eaf-a2fade598333 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:19.297855 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b99872e9-f2c6-4fa4-9eaf-a2fade598333 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1406 microversion: 2.20 time: 0.225470 Jan 10 11:38:19.298476 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 67/133] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:19 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:38:19.303063 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9d2f2795-67c4-48fc-ae88-b978d8a78e44 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ad41d90-2cec-47d9-8e2f-c6bf2ee396d8"}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:19.304256 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9d2f2795-67c4-48fc-ae88-b978d8a78e44 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:19.310868 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9d2f2795-67c4-48fc-ae88-b978d8a78e44 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:19.311322 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9d2f2795-67c4-48fc-ae88-b978d8a78e44 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:19.312117 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9d2f2795-67c4-48fc-ae88-b978d8a78e44 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:19.312552 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9d2f2795-67c4-48fc-ae88-b978d8a78e44 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:19.751931 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-fa856d7c-3138-4643-b316-8d4cc7576ba3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "POST /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef/action" status: 200 len: 32 microversion: 2.1 time: 0.716219 Jan 10 11:38:19.758565 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 67/134] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:19 2022] POST /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef/action => generated 32 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 10 11:38:19.763982 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-71555aa4-069c-4925-a9df-a2453a7abb3f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:19.764682 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-71555aa4-069c-4925-a9df-a2453a7abb3f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:19.771706 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-71555aa4-069c-4925-a9df-a2453a7abb3f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:19.771706 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-71555aa4-069c-4925-a9df-a2453a7abb3f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:19.772085 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-71555aa4-069c-4925-a9df-a2453a7abb3f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:19.773156 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-71555aa4-069c-4925-a9df-a2453a7abb3f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:19.956458 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-71555aa4-069c-4925-a9df-a2453a7abb3f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:19.965553 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-71555aa4-069c-4925-a9df-a2453a7abb3f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.205659 Jan 10 11:38:19.966125 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 68/135] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:19 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:20.024518 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b20fe201-fc9b-41b0-aa06-4c5be6da8abe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:20.025130 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b20fe201-fc9b-41b0-aa06-4c5be6da8abe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:20.031107 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b20fe201-fc9b-41b0-aa06-4c5be6da8abe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:20.031664 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b20fe201-fc9b-41b0-aa06-4c5be6da8abe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:20.032488 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b20fe201-fc9b-41b0-aa06-4c5be6da8abe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:20.032920 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b20fe201-fc9b-41b0-aa06-4c5be6da8abe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:20.277394 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b20fe201-fc9b-41b0-aa06-4c5be6da8abe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:20.285315 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b20fe201-fc9b-41b0-aa06-4c5be6da8abe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1364 microversion: 2.1 time: 0.265065 Jan 10 11:38:20.285923 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 69/136] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:20 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1364 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:20.324658 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-85063bf7-2fa5-47c7-9b8d-6d9cf4907f7e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:20.329770 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-85063bf7-2fa5-47c7-9b8d-6d9cf4907f7e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:20.339800 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-85063bf7-2fa5-47c7-9b8d-6d9cf4907f7e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:20.340402 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-85063bf7-2fa5-47c7-9b8d-6d9cf4907f7e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:20.342924 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-85063bf7-2fa5-47c7-9b8d-6d9cf4907f7e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:20.343384 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-85063bf7-2fa5-47c7-9b8d-6d9cf4907f7e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:20.608427 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9d2f2795-67c4-48fc-ae88-b978d8a78e44 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "POST /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.308583 Jan 10 11:38:20.609903 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 68/137] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jan 10 11:38:19 2022] POST /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0/os-volume_attachments => generated 194 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:38:20.616577 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b7842e2f-d4ac-4429-90dc-efbfb2a7e3a5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0274db86-8945-4ba7-abc6-3d1c3c6e5c1e"}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:20.619211 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b7842e2f-d4ac-4429-90dc-efbfb2a7e3a5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:20.627266 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b7842e2f-d4ac-4429-90dc-efbfb2a7e3a5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:20.627865 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b7842e2f-d4ac-4429-90dc-efbfb2a7e3a5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:20.628809 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b7842e2f-d4ac-4429-90dc-efbfb2a7e3a5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:20.629352 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b7842e2f-d4ac-4429-90dc-efbfb2a7e3a5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:20.649824 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-85063bf7-2fa5-47c7-9b8d-6d9cf4907f7e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:20.660226 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-85063bf7-2fa5-47c7-9b8d-6d9cf4907f7e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:20.662308 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-85063bf7-2fa5-47c7-9b8d-6d9cf4907f7e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:20.664940 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-85063bf7-2fa5-47c7-9b8d-6d9cf4907f7e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1406 microversion: 2.20 time: 0.351654 Jan 10 11:38:20.665747 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 70/138] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:20 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1406 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:38:20.990843 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-df1f76e3-1fef-4007-9b86-ed551e08c5df tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:20.992740 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-df1f76e3-1fef-4007-9b86-ed551e08c5df tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:20.998937 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-df1f76e3-1fef-4007-9b86-ed551e08c5df tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:20.999377 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-df1f76e3-1fef-4007-9b86-ed551e08c5df tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:21.000352 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-df1f76e3-1fef-4007-9b86-ed551e08c5df tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:21.001483 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-df1f76e3-1fef-4007-9b86-ed551e08c5df tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:21.180328 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-df1f76e3-1fef-4007-9b86-ed551e08c5df tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:21.195939 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-df1f76e3-1fef-4007-9b86-ed551e08c5df tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.208336 Jan 10 11:38:21.197161 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 71/139] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:20 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:21.206014 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-4e51ec5e-bf36-478d-b9a7-0834c9825533 req-19334feb-cf23-445d-a567-905f62215359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de742531-93dd-4422-b11c-57c35a136f6e", "name": "network-vif-plugged", "status": "completed", "tag": "1402bd72-ebce-40e3-b2fe-9132d0fbe846"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:21.209540 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:38:21.209540 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:38:21.224404 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-4e51ec5e-bf36-478d-b9a7-0834c9825533 req-19334feb-cf23-445d-a567-905f62215359 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:21.225869 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-4e51ec5e-bf36-478d-b9a7-0834c9825533 req-19334feb-cf23-445d-a567-905f62215359 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:21.250575 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-4e51ec5e-bf36-478d-b9a7-0834c9825533 req-19334feb-cf23-445d-a567-905f62215359 service nova] Creating event network-vif-plugged:1402bd72-ebce-40e3-b2fe-9132d0fbe846 for instance de742531-93dd-4422-b11c-57c35a136f6e on hv-cinder-maste Jan 10 11:38:21.259802 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-4e51ec5e-bf36-478d-b9a7-0834c9825533 req-19334feb-cf23-445d-a567-905f62215359 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060321 Jan 10 11:38:21.260888 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 72/140] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:38:21.306342 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f91ce90a-39e3-4ebd-b687-55a090a9f446 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:21.307219 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f91ce90a-39e3-4ebd-b687-55a090a9f446 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:21.313714 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f91ce90a-39e3-4ebd-b687-55a090a9f446 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:21.314035 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f91ce90a-39e3-4ebd-b687-55a090a9f446 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:21.314847 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f91ce90a-39e3-4ebd-b687-55a090a9f446 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:21.315312 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f91ce90a-39e3-4ebd-b687-55a090a9f446 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:21.469392 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f91ce90a-39e3-4ebd-b687-55a090a9f446 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:21.478565 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f91ce90a-39e3-4ebd-b687-55a090a9f446 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1364 microversion: 2.1 time: 0.177453 Jan 10 11:38:21.479783 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 73/141] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:21 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:21.689186 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4fd33451-8f18-4a59-82b3-e6681fe0f655 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:21.689788 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4fd33451-8f18-4a59-82b3-e6681fe0f655 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:21.696869 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4fd33451-8f18-4a59-82b3-e6681fe0f655 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:21.697503 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4fd33451-8f18-4a59-82b3-e6681fe0f655 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:21.698148 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4fd33451-8f18-4a59-82b3-e6681fe0f655 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:21.698875 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4fd33451-8f18-4a59-82b3-e6681fe0f655 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:21.886242 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4fd33451-8f18-4a59-82b3-e6681fe0f655 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:21.894675 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4fd33451-8f18-4a59-82b3-e6681fe0f655 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:21.896288 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4fd33451-8f18-4a59-82b3-e6681fe0f655 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:21.897972 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4fd33451-8f18-4a59-82b3-e6681fe0f655 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1406 microversion: 2.20 time: 0.212252 Jan 10 11:38:21.911385 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 74/142] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:21 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:38:22.222987 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a4c11681-e16f-4a8c-9a21-203ef8f59d07 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:22.222987 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a4c11681-e16f-4a8c-9a21-203ef8f59d07 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:22.222987 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a4c11681-e16f-4a8c-9a21-203ef8f59d07 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:22.222987 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a4c11681-e16f-4a8c-9a21-203ef8f59d07 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:22.224041 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a4c11681-e16f-4a8c-9a21-203ef8f59d07 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:22.224041 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a4c11681-e16f-4a8c-9a21-203ef8f59d07 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:22.400064 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-a4c11681-e16f-4a8c-9a21-203ef8f59d07 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:22.408958 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a4c11681-e16f-4a8c-9a21-203ef8f59d07 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.198398 Jan 10 11:38:22.409565 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 75/143] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:22 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:22.507356 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-76844916-c177-41f7-9891-99edf3b0b95e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:22.507356 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-76844916-c177-41f7-9891-99edf3b0b95e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:22.521540 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-76844916-c177-41f7-9891-99edf3b0b95e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:22.521540 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-76844916-c177-41f7-9891-99edf3b0b95e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:22.521540 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-76844916-c177-41f7-9891-99edf3b0b95e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:22.521540 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-76844916-c177-41f7-9891-99edf3b0b95e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:22.566515 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b7842e2f-d4ac-4429-90dc-efbfb2a7e3a5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "POST /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.954334 Jan 10 11:38:22.571410 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 69/144] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jan 10 11:38:20 2022] POST /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00/os-volume_attachments => generated 194 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:38:22.698151 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-76844916-c177-41f7-9891-99edf3b0b95e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:22.711073 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-76844916-c177-41f7-9891-99edf3b0b95e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1364 microversion: 2.1 time: 0.210146 Jan 10 11:38:22.727558 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 76/145] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:22 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:22.929361 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ffde829a-0689-440a-b2e0-7e24a5c0db12 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:22.930470 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ffde829a-0689-440a-b2e0-7e24a5c0db12 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:22.937034 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ffde829a-0689-440a-b2e0-7e24a5c0db12 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:22.937487 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ffde829a-0689-440a-b2e0-7e24a5c0db12 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:22.938328 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ffde829a-0689-440a-b2e0-7e24a5c0db12 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:22.938749 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ffde829a-0689-440a-b2e0-7e24a5c0db12 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:23.077911 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ffde829a-0689-440a-b2e0-7e24a5c0db12 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:23.087056 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ffde829a-0689-440a-b2e0-7e24a5c0db12 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:23.088597 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ffde829a-0689-440a-b2e0-7e24a5c0db12 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:23.089710 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ffde829a-0689-440a-b2e0-7e24a5c0db12 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1406 microversion: 2.20 time: 0.165094 Jan 10 11:38:23.090295 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 70/146] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:22 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:38:23.277749 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-2a757caa-3130-498e-8082-3969afa48f3b req-2584c456-4310-4fff-babd-20b27f849a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb58298d-9795-4c2b-86b6-3b17b668765f", "name": "network-vif-plugged", "status": "completed", "tag": "ad9b761f-8e30-4890-b16f-aceb4777ab0b"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:23.279435 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:38:23.279435 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:38:23.286411 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-2a757caa-3130-498e-8082-3969afa48f3b req-2584c456-4310-4fff-babd-20b27f849a7b service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:23.286848 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-2a757caa-3130-498e-8082-3969afa48f3b req-2584c456-4310-4fff-babd-20b27f849a7b service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:23.298676 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-2a757caa-3130-498e-8082-3969afa48f3b req-2584c456-4310-4fff-babd-20b27f849a7b service nova] Creating event network-vif-plugged:ad9b761f-8e30-4890-b16f-aceb4777ab0b for instance bb58298d-9795-4c2b-86b6-3b17b668765f on hv-cinder-maste Jan 10 11:38:23.303567 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-2a757caa-3130-498e-8082-3969afa48f3b req-2584c456-4310-4fff-babd-20b27f849a7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029380 Jan 10 11:38:23.304160 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 77/147] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:38:23.426790 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a1c45644-4645-462a-bcff-f43ceb1fc262 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:23.427395 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a1c45644-4645-462a-bcff-f43ceb1fc262 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:23.434250 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a1c45644-4645-462a-bcff-f43ceb1fc262 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:23.434707 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a1c45644-4645-462a-bcff-f43ceb1fc262 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:23.435491 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a1c45644-4645-462a-bcff-f43ceb1fc262 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:23.435929 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a1c45644-4645-462a-bcff-f43ceb1fc262 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:23.581559 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a1c45644-4645-462a-bcff-f43ceb1fc262 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:23.590302 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a1c45644-4645-462a-bcff-f43ceb1fc262 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.167121 Jan 10 11:38:23.590906 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 71/148] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:23 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:23.736038 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ddfac466-f4da-49da-95d1-9c2a5eacfbd3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:23.736742 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ddfac466-f4da-49da-95d1-9c2a5eacfbd3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:23.746160 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ddfac466-f4da-49da-95d1-9c2a5eacfbd3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:23.746919 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ddfac466-f4da-49da-95d1-9c2a5eacfbd3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:23.747957 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ddfac466-f4da-49da-95d1-9c2a5eacfbd3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:23.751234 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ddfac466-f4da-49da-95d1-9c2a5eacfbd3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:24.024951 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ddfac466-f4da-49da-95d1-9c2a5eacfbd3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:24.032561 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ddfac466-f4da-49da-95d1-9c2a5eacfbd3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1548 microversion: 2.1 time: 0.301159 Jan 10 11:38:24.033139 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 78/149] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:23 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1548 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:24.050253 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a11ed0f0-b852-46fe-ad2a-d266b12739f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:24.050824 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a11ed0f0-b852-46fe-ad2a-d266b12739f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:24.058415 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a11ed0f0-b852-46fe-ad2a-d266b12739f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:24.058876 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a11ed0f0-b852-46fe-ad2a-d266b12739f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:24.059838 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a11ed0f0-b852-46fe-ad2a-d266b12739f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:24.060444 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a11ed0f0-b852-46fe-ad2a-d266b12739f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:24.112278 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-53d4ea08-4d5b-4302-b09b-1587983d3217 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:24.113517 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-53d4ea08-4d5b-4302-b09b-1587983d3217 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:24.123587 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-53d4ea08-4d5b-4302-b09b-1587983d3217 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:24.124094 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-53d4ea08-4d5b-4302-b09b-1587983d3217 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:24.125050 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-53d4ea08-4d5b-4302-b09b-1587983d3217 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:24.125686 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-53d4ea08-4d5b-4302-b09b-1587983d3217 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:24.153510 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a11ed0f0-b852-46fe-ad2a-d266b12739f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106669 Jan 10 11:38:24.154190 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 72/150] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jan 10 11:38:24 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:38:24.274135 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-53d4ea08-4d5b-4302-b09b-1587983d3217 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:24.285205 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-53d4ea08-4d5b-4302-b09b-1587983d3217 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:24.287344 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-53d4ea08-4d5b-4302-b09b-1587983d3217 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:24.288572 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-53d4ea08-4d5b-4302-b09b-1587983d3217 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1406 microversion: 2.20 time: 0.183342 Jan 10 11:38:24.289490 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 79/151] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:24 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:38:24.608637 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-63ce8552-7678-41fc-80a4-8e41c93ffc98 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:24.609316 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-63ce8552-7678-41fc-80a4-8e41c93ffc98 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:24.620581 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-63ce8552-7678-41fc-80a4-8e41c93ffc98 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:24.621214 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-63ce8552-7678-41fc-80a4-8e41c93ffc98 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:24.622181 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-63ce8552-7678-41fc-80a4-8e41c93ffc98 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:24.622746 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-63ce8552-7678-41fc-80a4-8e41c93ffc98 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:24.826100 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-63ce8552-7678-41fc-80a4-8e41c93ffc98 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:24.842463 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-63ce8552-7678-41fc-80a4-8e41c93ffc98 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.237921 Jan 10 11:38:24.843152 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 73/152] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:24 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:25.311205 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-234b1ffb-88aa-4c39-a940-0185862cc7ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:25.312298 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-234b1ffb-88aa-4c39-a940-0185862cc7ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:25.323347 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-234b1ffb-88aa-4c39-a940-0185862cc7ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:25.323807 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-234b1ffb-88aa-4c39-a940-0185862cc7ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:25.324763 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-234b1ffb-88aa-4c39-a940-0185862cc7ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:25.325320 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-234b1ffb-88aa-4c39-a940-0185862cc7ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:25.472140 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-234b1ffb-88aa-4c39-a940-0185862cc7ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:25.481098 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-234b1ffb-88aa-4c39-a940-0185862cc7ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:25.483351 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-234b1ffb-88aa-4c39-a940-0185862cc7ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:25.484504 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-234b1ffb-88aa-4c39-a940-0185862cc7ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1406 microversion: 2.20 time: 0.180748 Jan 10 11:38:25.485066 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 80/153] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:25 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:38:25.869981 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ec88198b-e5af-4cb4-b246-dd3499c489d1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:25.870836 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ec88198b-e5af-4cb4-b246-dd3499c489d1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:25.881560 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ec88198b-e5af-4cb4-b246-dd3499c489d1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:25.886954 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ec88198b-e5af-4cb4-b246-dd3499c489d1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:25.888211 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ec88198b-e5af-4cb4-b246-dd3499c489d1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:25.889555 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ec88198b-e5af-4cb4-b246-dd3499c489d1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:26.066247 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ec88198b-e5af-4cb4-b246-dd3499c489d1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:26.077536 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ec88198b-e5af-4cb4-b246-dd3499c489d1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.212349 Jan 10 11:38:26.081098 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 74/154] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:25 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:26.107021 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8bcb7c75-a7c3-48ab-bdd4-7a006238f8c7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:26.108594 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-8bcb7c75-a7c3-48ab-bdd4-7a006238f8c7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:26.114733 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-817517a2-2993-48a7-8d25-215d3f505d25 req-267a662e-4d72-49cc-b47a-d54e6dd1a799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de742531-93dd-4422-b11c-57c35a136f6e", "tag": "1402bd72-ebce-40e3-b2fe-9132d0fbe846"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:26.114733 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:38:26.114733 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:38:26.116079 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8bcb7c75-a7c3-48ab-bdd4-7a006238f8c7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:26.116815 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8bcb7c75-a7c3-48ab-bdd4-7a006238f8c7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:26.118160 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8bcb7c75-a7c3-48ab-bdd4-7a006238f8c7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:26.118901 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8bcb7c75-a7c3-48ab-bdd4-7a006238f8c7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:26.122261 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-817517a2-2993-48a7-8d25-215d3f505d25 req-267a662e-4d72-49cc-b47a-d54e6dd1a799 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:26.122708 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-817517a2-2993-48a7-8d25-215d3f505d25 req-267a662e-4d72-49cc-b47a-d54e6dd1a799 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:26.136033 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-817517a2-2993-48a7-8d25-215d3f505d25 req-267a662e-4d72-49cc-b47a-d54e6dd1a799 service nova] Creating event network-changed:1402bd72-ebce-40e3-b2fe-9132d0fbe846 for instance de742531-93dd-4422-b11c-57c35a136f6e on hv-cinder-maste Jan 10 11:38:26.143016 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-817517a2-2993-48a7-8d25-215d3f505d25 req-267a662e-4d72-49cc-b47a-d54e6dd1a799 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036178 Jan 10 11:38:26.143976 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 75/155] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:38:26.232059 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-8bcb7c75-a7c3-48ab-bdd4-7a006238f8c7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 14 microversion: 2.1 time: 0.128455 Jan 10 11:38:26.232745 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 81/156] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:26 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:38:26.504308 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5ff936dd-0f0a-44c0-97f9-6ba9741b64c2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:26.505371 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5ff936dd-0f0a-44c0-97f9-6ba9741b64c2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:26.512762 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5ff936dd-0f0a-44c0-97f9-6ba9741b64c2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:26.513607 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5ff936dd-0f0a-44c0-97f9-6ba9741b64c2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:26.514511 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5ff936dd-0f0a-44c0-97f9-6ba9741b64c2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:26.514947 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5ff936dd-0f0a-44c0-97f9-6ba9741b64c2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:26.668318 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5ff936dd-0f0a-44c0-97f9-6ba9741b64c2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:26.677204 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5ff936dd-0f0a-44c0-97f9-6ba9741b64c2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:26.679494 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5ff936dd-0f0a-44c0-97f9-6ba9741b64c2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:26.680837 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5ff936dd-0f0a-44c0-97f9-6ba9741b64c2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1597 microversion: 2.20 time: 0.180633 Jan 10 11:38:26.681421 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 76/157] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:38:26 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1597 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:38:26.713187 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-6f5b66fe-3f21-40c5-97ab-01b2f6534f4e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:26.713187 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-6f5b66fe-3f21-40c5-97ab-01b2f6534f4e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:26.719910 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6f5b66fe-3f21-40c5-97ab-01b2f6534f4e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:26.720366 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6f5b66fe-3f21-40c5-97ab-01b2f6534f4e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:26.721173 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6f5b66fe-3f21-40c5-97ab-01b2f6534f4e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:26.721729 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6f5b66fe-3f21-40c5-97ab-01b2f6534f4e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:26.809097 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-6f5b66fe-3f21-40c5-97ab-01b2f6534f4e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101983 Jan 10 11:38:26.809785 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 82/158] 10.222.0.20 () {60 vars in 1315 bytes} [Mon Jan 10 11:38:26 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:38:27.107996 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-351ba8a2-37b6-477a-926c-5a9436702768 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:27.109485 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-351ba8a2-37b6-477a-926c-5a9436702768 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:27.121114 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-351ba8a2-37b6-477a-926c-5a9436702768 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:27.122747 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-351ba8a2-37b6-477a-926c-5a9436702768 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:27.124093 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-351ba8a2-37b6-477a-926c-5a9436702768 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:27.124810 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-351ba8a2-37b6-477a-926c-5a9436702768 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:27.246475 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-dfe7007a-2eb5-409f-9fdd-173b3d249283 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:27.248059 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-dfe7007a-2eb5-409f-9fdd-173b3d249283 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:27.254662 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dfe7007a-2eb5-409f-9fdd-173b3d249283 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:27.255434 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dfe7007a-2eb5-409f-9fdd-173b3d249283 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:27.256585 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dfe7007a-2eb5-409f-9fdd-173b3d249283 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:27.257498 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dfe7007a-2eb5-409f-9fdd-173b3d249283 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:27.291022 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-351ba8a2-37b6-477a-926c-5a9436702768 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:27.300005 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-351ba8a2-37b6-477a-926c-5a9436702768 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.204900 Jan 10 11:38:27.309350 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 77/159] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:27 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:28.310848 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-da7443c2-6078-4343-8597-86f77091e555 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:28.311965 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-da7443c2-6078-4343-8597-86f77091e555 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:28.329517 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-da7443c2-6078-4343-8597-86f77091e555 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:28.330163 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-da7443c2-6078-4343-8597-86f77091e555 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:28.331143 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-da7443c2-6078-4343-8597-86f77091e555 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:28.331746 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-da7443c2-6078-4343-8597-86f77091e555 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:29.794928 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-dfe7007a-2eb5-409f-9fdd-173b3d249283 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 14 microversion: 2.1 time: 2.553388 Jan 10 11:38:29.796231 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 83/160] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:27 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 14 bytes in 2555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:38:29.804380 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-3cccf566-1b03-4387-9333-8a2216a037f0 req-16bfde6b-4025-4bda-a69c-e99680a106e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb58298d-9795-4c2b-86b6-3b17b668765f", "tag": "ad9b761f-8e30-4890-b16f-aceb4777ab0b"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:29.806180 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:38:29.806180 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:38:29.815013 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-3cccf566-1b03-4387-9333-8a2216a037f0 req-16bfde6b-4025-4bda-a69c-e99680a106e4 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:29.815474 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-3cccf566-1b03-4387-9333-8a2216a037f0 req-16bfde6b-4025-4bda-a69c-e99680a106e4 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:29.818239 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-da7443c2-6078-4343-8597-86f77091e555 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 14 microversion: 2.20 time: 1.512161 Jan 10 11:38:29.823847 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 78/161] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:28 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 14 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:29.825648 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-830fec8b-8d93-4414-b24b-8eb6d39704c2 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:29.826400 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-830fec8b-8d93-4414-b24b-8eb6d39704c2 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:29.827985 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-3cccf566-1b03-4387-9333-8a2216a037f0 req-16bfde6b-4025-4bda-a69c-e99680a106e4 service nova] Creating event network-changed:ad9b761f-8e30-4890-b16f-aceb4777ab0b for instance bb58298d-9795-4c2b-86b6-3b17b668765f on hv-cinder-maste Jan 10 11:38:29.833278 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-3cccf566-1b03-4387-9333-8a2216a037f0 req-16bfde6b-4025-4bda-a69c-e99680a106e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036080 Jan 10 11:38:29.833598 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-830fec8b-8d93-4414-b24b-8eb6d39704c2 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:29.833874 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 84/162] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:38:29.834059 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-830fec8b-8d93-4414-b24b-8eb6d39704c2 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:29.835288 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-830fec8b-8d93-4414-b24b-8eb6d39704c2 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:29.835747 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-830fec8b-8d93-4414-b24b-8eb6d39704c2 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:30.110306 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-830fec8b-8d93-4414-b24b-8eb6d39704c2 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:30.126575 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-830fec8b-8d93-4414-b24b-8eb6d39704c2 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.303292 Jan 10 11:38:30.127062 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 79/163] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:29 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:30.808699 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7849582f-a673-411f-9422-3ebadda86070 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:30.809741 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7849582f-a673-411f-9422-3ebadda86070 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:30.816233 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7849582f-a673-411f-9422-3ebadda86070 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:30.816687 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7849582f-a673-411f-9422-3ebadda86070 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:30.817478 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7849582f-a673-411f-9422-3ebadda86070 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:30.817908 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7849582f-a673-411f-9422-3ebadda86070 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:30.836310 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-28a9207e-d63d-401b-928d-5ebfc6a0b30e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:30.837937 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-28a9207e-d63d-401b-928d-5ebfc6a0b30e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:30.850485 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-28a9207e-d63d-401b-928d-5ebfc6a0b30e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:30.851747 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-28a9207e-d63d-401b-928d-5ebfc6a0b30e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:30.852821 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-28a9207e-d63d-401b-928d-5ebfc6a0b30e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:30.853266 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-28a9207e-d63d-401b-928d-5ebfc6a0b30e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:33.141718 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7849582f-a673-411f-9422-3ebadda86070 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 14 microversion: 2.1 time: 2.337169 Jan 10 11:38:33.142811 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 85/164] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:30 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 14 bytes in 2340 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:38:33.148947 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-79a9157a-0726-4827-9188-2810ab040b94 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:33.149747 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-79a9157a-0726-4827-9188-2810ab040b94 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:33.151780 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-28a9207e-d63d-401b-928d-5ebfc6a0b30e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 14 microversion: 2.20 time: 2.322893 Jan 10 11:38:33.156608 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 80/165] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:30 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 14 bytes in 2325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:33.157450 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-79a9157a-0726-4827-9188-2810ab040b94 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:33.157794 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-79a9157a-0726-4827-9188-2810ab040b94 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:33.158630 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-79a9157a-0726-4827-9188-2810ab040b94 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:33.159070 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-79a9157a-0726-4827-9188-2810ab040b94 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:33.472234 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-79a9157a-0726-4827-9188-2810ab040b94 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:33.479006 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-79a9157a-0726-4827-9188-2810ab040b94 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.334751 Jan 10 11:38:33.479918 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 86/166] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:33 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:34.154125 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f7da8e22-3fe1-49aa-88d0-7760b81c25d4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:34.155227 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f7da8e22-3fe1-49aa-88d0-7760b81c25d4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:34.162388 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f7da8e22-3fe1-49aa-88d0-7760b81c25d4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:34.162837 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f7da8e22-3fe1-49aa-88d0-7760b81c25d4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:34.164136 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f7da8e22-3fe1-49aa-88d0-7760b81c25d4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:34.164664 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f7da8e22-3fe1-49aa-88d0-7760b81c25d4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:34.165947 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-df8fd8c1-02d0-44d6-9f90-53fc6a2cca62 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:34.166945 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-df8fd8c1-02d0-44d6-9f90-53fc6a2cca62 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:34.174112 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-df8fd8c1-02d0-44d6-9f90-53fc6a2cca62 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:34.174613 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-df8fd8c1-02d0-44d6-9f90-53fc6a2cca62 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:34.175408 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-df8fd8c1-02d0-44d6-9f90-53fc6a2cca62 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:34.175846 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-df8fd8c1-02d0-44d6-9f90-53fc6a2cca62 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:34.245208 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f7da8e22-3fe1-49aa-88d0-7760b81c25d4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 14 microversion: 2.1 time: 0.094986 Jan 10 11:38:34.245847 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 81/167] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:34 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:38:34.295330 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-df8fd8c1-02d0-44d6-9f90-53fc6a2cca62 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 14 microversion: 2.20 time: 0.133371 Jan 10 11:38:34.295894 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 87/168] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:34 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:34.496348 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3ace8685-ed0c-41ea-b29b-2eaf1618bce7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:34.497057 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-3ace8685-ed0c-41ea-b29b-2eaf1618bce7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:34.504400 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3ace8685-ed0c-41ea-b29b-2eaf1618bce7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:34.504861 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3ace8685-ed0c-41ea-b29b-2eaf1618bce7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:34.505849 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3ace8685-ed0c-41ea-b29b-2eaf1618bce7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:34.506353 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3ace8685-ed0c-41ea-b29b-2eaf1618bce7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:34.675330 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-3ace8685-ed0c-41ea-b29b-2eaf1618bce7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:34.685805 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3ace8685-ed0c-41ea-b29b-2eaf1618bce7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.193859 Jan 10 11:38:34.686479 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 82/169] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:34 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:35.259071 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-6f3f6ca5-4016-4e3f-9c8e-9dfd8456c1ea tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:35.262520 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-6f3f6ca5-4016-4e3f-9c8e-9dfd8456c1ea tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:35.282667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6f3f6ca5-4016-4e3f-9c8e-9dfd8456c1ea tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:35.282667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6f3f6ca5-4016-4e3f-9c8e-9dfd8456c1ea tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:35.282667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6f3f6ca5-4016-4e3f-9c8e-9dfd8456c1ea tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:35.282667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6f3f6ca5-4016-4e3f-9c8e-9dfd8456c1ea tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:35.313063 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2a237b6d-50d4-467d-8b79-fe8999bca256 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:35.314688 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2a237b6d-50d4-467d-8b79-fe8999bca256 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:35.327669 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a237b6d-50d4-467d-8b79-fe8999bca256 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:35.329380 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a237b6d-50d4-467d-8b79-fe8999bca256 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:35.332351 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a237b6d-50d4-467d-8b79-fe8999bca256 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:35.334522 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a237b6d-50d4-467d-8b79-fe8999bca256 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:35.392299 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-6f3f6ca5-4016-4e3f-9c8e-9dfd8456c1ea tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 14 microversion: 2.1 time: 0.138975 Jan 10 11:38:35.397724 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 88/170] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:35 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:38:35.623101 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2a237b6d-50d4-467d-8b79-fe8999bca256 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 14 microversion: 2.20 time: 0.319140 Jan 10 11:38:35.623850 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 83/171] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:35 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 14 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:35.707732 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-d64ba8d1-f43e-4462-adf9-50369ad11f31 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:35.708826 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-d64ba8d1-f43e-4462-adf9-50369ad11f31 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:35.720391 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d64ba8d1-f43e-4462-adf9-50369ad11f31 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:35.720771 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d64ba8d1-f43e-4462-adf9-50369ad11f31 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:35.721583 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d64ba8d1-f43e-4462-adf9-50369ad11f31 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:35.722034 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d64ba8d1-f43e-4462-adf9-50369ad11f31 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:35.878745 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-d64ba8d1-f43e-4462-adf9-50369ad11f31 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:35.887292 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-d64ba8d1-f43e-4462-adf9-50369ad11f31 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.185604 Jan 10 11:38:35.887894 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 89/172] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:35 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:36.405665 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9d01bff6-dd9f-40b0-b9b4-337cda0f9d21 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:36.406707 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9d01bff6-dd9f-40b0-b9b4-337cda0f9d21 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:36.413937 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9d01bff6-dd9f-40b0-b9b4-337cda0f9d21 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:36.414418 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9d01bff6-dd9f-40b0-b9b4-337cda0f9d21 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:36.415219 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9d01bff6-dd9f-40b0-b9b4-337cda0f9d21 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:36.415650 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9d01bff6-dd9f-40b0-b9b4-337cda0f9d21 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:36.501781 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9d01bff6-dd9f-40b0-b9b4-337cda0f9d21 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 14 microversion: 2.1 time: 0.095109 Jan 10 11:38:36.501781 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 84/173] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:36 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:38:36.636739 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-125a34d3-911a-4704-b6a8-bb9804e14fd4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:36.637964 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-125a34d3-911a-4704-b6a8-bb9804e14fd4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:36.646691 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-125a34d3-911a-4704-b6a8-bb9804e14fd4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:36.647598 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-125a34d3-911a-4704-b6a8-bb9804e14fd4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:36.648982 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-125a34d3-911a-4704-b6a8-bb9804e14fd4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:36.649694 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-125a34d3-911a-4704-b6a8-bb9804e14fd4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:36.746069 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-125a34d3-911a-4704-b6a8-bb9804e14fd4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 14 microversion: 2.20 time: 0.113675 Jan 10 11:38:36.750177 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 90/174] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:36 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:36.909131 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-6cabb3e1-d662-4006-81ec-65f8c3b4f06c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:36.911066 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-6cabb3e1-d662-4006-81ec-65f8c3b4f06c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:36.924293 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6cabb3e1-d662-4006-81ec-65f8c3b4f06c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:36.925163 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6cabb3e1-d662-4006-81ec-65f8c3b4f06c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:36.926927 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6cabb3e1-d662-4006-81ec-65f8c3b4f06c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:36.927995 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6cabb3e1-d662-4006-81ec-65f8c3b4f06c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:36.957205 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-76b04237-8476-4292-9ee8-df8be252cde0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1438931497", "imageRef": "b6e63192-9c33-4d80-9555-6de2bb10fd32", "flavorRef": "452", "networks": [{"uuid": "73452465-d5d7-4c27-928c-80c648c05035"}]}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:37.025121 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.network.neutron [None req-76b04237-8476-4292-9ee8-df8be252cde0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] validate_networks() for [('73452465-d5d7-4c27-928c-80c648c05035', None, None, None, None, None)] {{(pid=128718) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:38:37.236699 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-6cabb3e1-d662-4006-81ec-65f8c3b4f06c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:37.247549 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-6cabb3e1-d662-4006-81ec-65f8c3b4f06c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.345033 Jan 10 11:38:37.248275 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 85/175] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:36 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:37.516997 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e94ff87c-769f-4887-9c9e-31b6ec2950bb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:37.518751 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-e94ff87c-769f-4887-9c9e-31b6ec2950bb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:37.547576 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e94ff87c-769f-4887-9c9e-31b6ec2950bb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:37.548347 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e94ff87c-769f-4887-9c9e-31b6ec2950bb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:37.549563 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e94ff87c-769f-4887-9c9e-31b6ec2950bb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:37.551952 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e94ff87c-769f-4887-9c9e-31b6ec2950bb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:37.620281 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-76b04237-8476-4292-9ee8-df8be252cde0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Flavor limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:38:37.620281 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-76b04237-8476-4292-9ee8-df8be252cde0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Image limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:38:37.620584 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-76b04237-8476-4292-9ee8-df8be252cde0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Flavor pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:38:37.620949 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-76b04237-8476-4292-9ee8-df8be252cde0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Image pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:38:37.621476 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-76b04237-8476-4292-9ee8-df8be252cde0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:38:37.632924 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-76b04237-8476-4292-9ee8-df8be252cde0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:37.633600 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-76b04237-8476-4292-9ee8-df8be252cde0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:37.634482 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-76b04237-8476-4292-9ee8-df8be252cde0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:37.634921 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-76b04237-8476-4292-9ee8-df8be252cde0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:37.649666 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-e94ff87c-769f-4887-9c9e-31b6ec2950bb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 14 microversion: 2.1 time: 0.140625 Jan 10 11:38:37.650466 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 86/176] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:37 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:38:37.657169 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-76b04237-8476-4292-9ee8-df8be252cde0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Getting quotas for project 1c300abbfb3b48dab6c40f20c7eb9cd1. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:38:37.662166 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-76b04237-8476-4292-9ee8-df8be252cde0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Getting quotas for user b6431c85b6c74608aae42e0e856d1a6d and project 1c300abbfb3b48dab6c40f20c7eb9cd1. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:38:37.675849 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-76b04237-8476-4292-9ee8-df8be252cde0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Going to run 1 instances... {{(pid=128718) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:38:37.678494 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-76b04237-8476-4292-9ee8-df8be252cde0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e63192-9c33-4d80-9555-6de2bb10fd32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:38:37.761904 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-98d797aa-22b4-43eb-826f-719795e9cca7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:37.764069 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-98d797aa-22b4-43eb-826f-719795e9cca7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:37.771516 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-98d797aa-22b4-43eb-826f-719795e9cca7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:37.771964 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-98d797aa-22b4-43eb-826f-719795e9cca7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:37.772781 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-98d797aa-22b4-43eb-826f-719795e9cca7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:37.773228 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-98d797aa-22b4-43eb-826f-719795e9cca7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:37.857860 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-98d797aa-22b4-43eb-826f-719795e9cca7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 14 microversion: 2.20 time: 0.102036 Jan 10 11:38:37.858991 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 87/177] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:37 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:37.904414 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-76b04237-8476-4292-9ee8-df8be252cde0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.951281 Jan 10 11:38:37.905080 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 91/178] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:38:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 10 11:38:37.916745 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-11297f44-4d9d-4d79-a55f-4c0d9dd2b555 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:37.917507 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-11297f44-4d9d-4d79-a55f-4c0d9dd2b555 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:37.979351 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-11297f44-4d9d-4d79-a55f-4c0d9dd2b555 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:37.992200 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-11297f44-4d9d-4d79-a55f-4c0d9dd2b555 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1218 microversion: 2.1 time: 0.079791 Jan 10 11:38:37.993193 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 88/179] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:37 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:38.269228 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-35b67471-d2e2-41e7-803b-afa7969aa642 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:38.269926 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-35b67471-d2e2-41e7-803b-afa7969aa642 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:38.279163 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-35b67471-d2e2-41e7-803b-afa7969aa642 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:38.279691 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-35b67471-d2e2-41e7-803b-afa7969aa642 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:38.282102 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-35b67471-d2e2-41e7-803b-afa7969aa642 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:38.282102 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-35b67471-d2e2-41e7-803b-afa7969aa642 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:38.496397 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-35b67471-d2e2-41e7-803b-afa7969aa642 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:38.507352 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-35b67471-d2e2-41e7-803b-afa7969aa642 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.242006 Jan 10 11:38:38.508224 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 92/180] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:38 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:38.661347 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b41f1eba-c0f9-4102-a797-747a0af85b68 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:38.663234 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b41f1eba-c0f9-4102-a797-747a0af85b68 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:38.679568 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b41f1eba-c0f9-4102-a797-747a0af85b68 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:38.680117 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b41f1eba-c0f9-4102-a797-747a0af85b68 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:38.681203 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b41f1eba-c0f9-4102-a797-747a0af85b68 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:38.682812 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b41f1eba-c0f9-4102-a797-747a0af85b68 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:38.791991 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b41f1eba-c0f9-4102-a797-747a0af85b68 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 14 microversion: 2.1 time: 0.134644 Jan 10 11:38:38.792642 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 89/181] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:38 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 10 11:38:38.873456 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c3c51eda-b3d1-4169-8771-c154062afdb5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:38.875259 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c3c51eda-b3d1-4169-8771-c154062afdb5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:38.886425 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c3c51eda-b3d1-4169-8771-c154062afdb5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:38.887109 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c3c51eda-b3d1-4169-8771-c154062afdb5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:38.888483 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c3c51eda-b3d1-4169-8771-c154062afdb5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:38.889419 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c3c51eda-b3d1-4169-8771-c154062afdb5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:39.016493 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a2d6102d-3fe1-4a6d-84de-359886c06759 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:39.017933 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a2d6102d-3fe1-4a6d-84de-359886c06759 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:39.020921 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c3c51eda-b3d1-4169-8771-c154062afdb5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 14 microversion: 2.20 time: 0.154612 Jan 10 11:38:39.022001 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 93/182] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:38 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:39.082114 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a2d6102d-3fe1-4a6d-84de-359886c06759 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:39.090463 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a2d6102d-3fe1-4a6d-84de-359886c06759 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1218 microversion: 2.1 time: 0.077851 Jan 10 11:38:39.091689 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 90/183] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:39 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:39.544112 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-d41cb865-227d-47b5-b4f1-7d6410675fa1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:39.545075 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-d41cb865-227d-47b5-b4f1-7d6410675fa1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:39.552970 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d41cb865-227d-47b5-b4f1-7d6410675fa1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:39.553420 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d41cb865-227d-47b5-b4f1-7d6410675fa1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:39.555369 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d41cb865-227d-47b5-b4f1-7d6410675fa1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:39.555809 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d41cb865-227d-47b5-b4f1-7d6410675fa1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:39.807264 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a285e24e-4f55-449c-9427-f49fca65f6c1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:39.808717 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a285e24e-4f55-449c-9427-f49fca65f6c1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:39.820545 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a285e24e-4f55-449c-9427-f49fca65f6c1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:39.821354 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a285e24e-4f55-449c-9427-f49fca65f6c1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:39.822721 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a285e24e-4f55-449c-9427-f49fca65f6c1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:39.823456 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a285e24e-4f55-449c-9427-f49fca65f6c1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:39.930818 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a285e24e-4f55-449c-9427-f49fca65f6c1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 14 microversion: 2.1 time: 0.130198 Jan 10 11:38:39.935962 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 91/184] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:39 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 10 11:38:40.048288 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-fe7bd9cc-b93a-481e-83f5-401c1efd21c2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:40.051921 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-fe7bd9cc-b93a-481e-83f5-401c1efd21c2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:40.063193 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fe7bd9cc-b93a-481e-83f5-401c1efd21c2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:40.063885 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fe7bd9cc-b93a-481e-83f5-401c1efd21c2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:40.065040 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fe7bd9cc-b93a-481e-83f5-401c1efd21c2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:40.065726 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fe7bd9cc-b93a-481e-83f5-401c1efd21c2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:40.167860 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-d41cb865-227d-47b5-b4f1-7d6410675fa1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:40.186193 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-d41cb865-227d-47b5-b4f1-7d6410675fa1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.649152 Jan 10 11:38:40.188864 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 94/185] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:39 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:40.189892 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-fe7bd9cc-b93a-481e-83f5-401c1efd21c2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 14 microversion: 2.20 time: 0.158180 Jan 10 11:38:40.190577 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 92/186] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:40 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:40.198030 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a8a8ffb9-0850-4d13-848b-30878f158fef tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:40.199568 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a8a8ffb9-0850-4d13-848b-30878f158fef tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:40.210831 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a8a8ffb9-0850-4d13-848b-30878f158fef tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:40.211667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a8a8ffb9-0850-4d13-848b-30878f158fef tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:40.213126 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a8a8ffb9-0850-4d13-848b-30878f158fef tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:40.213947 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a8a8ffb9-0850-4d13-848b-30878f158fef tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:40.307202 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-a8a8ffb9-0850-4d13-848b-30878f158fef tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:40.315004 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a8a8ffb9-0850-4d13-848b-30878f158fef tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1222 microversion: 2.1 time: 0.124411 Jan 10 11:38:40.315588 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 95/187] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:40 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:40.953028 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2cef831a-1d02-4259-907b-19e50aaa4ebe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:40.961060 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2cef831a-1d02-4259-907b-19e50aaa4ebe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:40.975379 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2cef831a-1d02-4259-907b-19e50aaa4ebe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:40.976582 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2cef831a-1d02-4259-907b-19e50aaa4ebe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:40.977886 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2cef831a-1d02-4259-907b-19e50aaa4ebe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:40.978661 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2cef831a-1d02-4259-907b-19e50aaa4ebe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:41.077533 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2cef831a-1d02-4259-907b-19e50aaa4ebe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 14 microversion: 2.1 time: 0.136583 Jan 10 11:38:41.079731 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 93/188] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:40 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:38:41.207536 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e6b34ba4-69e1-49fc-ae4f-44a663f60815 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:41.208241 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-36d1d0fa-fdc5-4f5e-9b7f-387fa9a74ef0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:41.208783 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e6b34ba4-69e1-49fc-ae4f-44a663f60815 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:41.208939 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-36d1d0fa-fdc5-4f5e-9b7f-387fa9a74ef0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:41.217448 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-36d1d0fa-fdc5-4f5e-9b7f-387fa9a74ef0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:41.218194 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-36d1d0fa-fdc5-4f5e-9b7f-387fa9a74ef0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:41.219103 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e6b34ba4-69e1-49fc-ae4f-44a663f60815 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:41.219389 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-36d1d0fa-fdc5-4f5e-9b7f-387fa9a74ef0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:41.219824 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e6b34ba4-69e1-49fc-ae4f-44a663f60815 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:41.220152 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-36d1d0fa-fdc5-4f5e-9b7f-387fa9a74ef0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:41.221240 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e6b34ba4-69e1-49fc-ae4f-44a663f60815 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:41.221762 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e6b34ba4-69e1-49fc-ae4f-44a663f60815 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:41.358774 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e6b34ba4-69e1-49fc-ae4f-44a663f60815 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 14 microversion: 2.20 time: 0.155506 Jan 10 11:38:41.360638 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 96/189] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:41 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:41.374705 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-76df9b0f-ac1f-4a92-9549-b471eb8cda1c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:41.381437 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-76df9b0f-ac1f-4a92-9549-b471eb8cda1c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:41.390368 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-76df9b0f-ac1f-4a92-9549-b471eb8cda1c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:41.391423 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-76df9b0f-ac1f-4a92-9549-b471eb8cda1c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:41.393178 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-76df9b0f-ac1f-4a92-9549-b471eb8cda1c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:41.394181 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-76df9b0f-ac1f-4a92-9549-b471eb8cda1c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:41.484860 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-76df9b0f-ac1f-4a92-9549-b471eb8cda1c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:41.496895 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-76df9b0f-ac1f-4a92-9549-b471eb8cda1c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1270 microversion: 2.1 time: 0.134337 Jan 10 11:38:41.498117 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 97/190] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:41 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1270 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:41.531042 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-36d1d0fa-fdc5-4f5e-9b7f-387fa9a74ef0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:41.539719 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-36d1d0fa-fdc5-4f5e-9b7f-387fa9a74ef0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.335787 Jan 10 11:38:41.541630 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 94/191] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:41 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:42.095561 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0994d38f-0871-428b-8f47-57b760764ba4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:42.096843 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0994d38f-0871-428b-8f47-57b760764ba4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:42.106658 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0994d38f-0871-428b-8f47-57b760764ba4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:42.107757 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0994d38f-0871-428b-8f47-57b760764ba4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:42.108802 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0994d38f-0871-428b-8f47-57b760764ba4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:42.109843 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0994d38f-0871-428b-8f47-57b760764ba4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:42.223060 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0994d38f-0871-428b-8f47-57b760764ba4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 14 microversion: 2.1 time: 0.134503 Jan 10 11:38:42.224381 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 98/192] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:42 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:38:42.377406 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3da91a60-763c-477c-8ba4-0294fcf0dead tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:42.379434 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-3da91a60-763c-477c-8ba4-0294fcf0dead tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:42.391892 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3da91a60-763c-477c-8ba4-0294fcf0dead tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:42.392989 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3da91a60-763c-477c-8ba4-0294fcf0dead tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:42.394676 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3da91a60-763c-477c-8ba4-0294fcf0dead tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:42.395868 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3da91a60-763c-477c-8ba4-0294fcf0dead tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:42.531101 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-9a42c99c-c044-46a3-bb17-371acc2329ad tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:42.533961 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3da91a60-763c-477c-8ba4-0294fcf0dead tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 14 microversion: 2.20 time: 0.164997 Jan 10 11:38:42.535283 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 95/193] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:42 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:42.536546 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-9a42c99c-c044-46a3-bb17-371acc2329ad tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:42.547503 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9a42c99c-c044-46a3-bb17-371acc2329ad tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:42.548348 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9a42c99c-c044-46a3-bb17-371acc2329ad tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:42.549766 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9a42c99c-c044-46a3-bb17-371acc2329ad tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:42.550688 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9a42c99c-c044-46a3-bb17-371acc2329ad tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:42.566091 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-cdcaa1cb-8f79-43a8-adc9-8f227fec0abb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:42.566971 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-cdcaa1cb-8f79-43a8-adc9-8f227fec0abb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:42.581198 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cdcaa1cb-8f79-43a8-adc9-8f227fec0abb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:42.586902 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cdcaa1cb-8f79-43a8-adc9-8f227fec0abb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:42.588022 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cdcaa1cb-8f79-43a8-adc9-8f227fec0abb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:42.588481 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cdcaa1cb-8f79-43a8-adc9-8f227fec0abb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:42.663856 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-9a42c99c-c044-46a3-bb17-371acc2329ad tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:42.675384 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-9a42c99c-c044-46a3-bb17-371acc2329ad tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1288 microversion: 2.1 time: 0.148390 Jan 10 11:38:42.675968 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 99/194] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:42 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1288 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:42.850440 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-cdcaa1cb-8f79-43a8-adc9-8f227fec0abb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:42.879240 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-cdcaa1cb-8f79-43a8-adc9-8f227fec0abb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.311625 Jan 10 11:38:42.889450 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 96/195] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:42 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:43.238856 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4c81260a-b4eb-472a-b359-5f5a3b356445 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:43.244702 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4c81260a-b4eb-472a-b359-5f5a3b356445 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:43.249047 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4c81260a-b4eb-472a-b359-5f5a3b356445 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:43.249727 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4c81260a-b4eb-472a-b359-5f5a3b356445 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:43.250894 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4c81260a-b4eb-472a-b359-5f5a3b356445 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:43.251586 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4c81260a-b4eb-472a-b359-5f5a3b356445 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:43.364073 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4c81260a-b4eb-472a-b359-5f5a3b356445 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 5186 microversion: 2.1 time: 0.129476 Jan 10 11:38:43.366590 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 100/196] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:43 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 5186 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:43.549546 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-905a93f0-32b9-45a3-85dc-4a80042ebd9e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:43.553838 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-905a93f0-32b9-45a3-85dc-4a80042ebd9e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:43.566715 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-905a93f0-32b9-45a3-85dc-4a80042ebd9e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:43.567608 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-905a93f0-32b9-45a3-85dc-4a80042ebd9e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:43.569110 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-905a93f0-32b9-45a3-85dc-4a80042ebd9e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:43.571319 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-905a93f0-32b9-45a3-85dc-4a80042ebd9e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:43.693957 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-13b21589-1103-4e0f-987f-73101a2c2b0e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:43.695844 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-13b21589-1103-4e0f-987f-73101a2c2b0e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:43.699671 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-905a93f0-32b9-45a3-85dc-4a80042ebd9e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 14 microversion: 2.20 time: 0.157064 Jan 10 11:38:43.704607 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 97/197] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:43 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:43.706137 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-13b21589-1103-4e0f-987f-73101a2c2b0e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:43.706819 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-13b21589-1103-4e0f-987f-73101a2c2b0e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:43.707870 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-13b21589-1103-4e0f-987f-73101a2c2b0e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:43.708465 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-13b21589-1103-4e0f-987f-73101a2c2b0e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:43.899070 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5ec71f2b-04bf-4120-b341-4f9e8ed9fe3b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:43.900376 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5ec71f2b-04bf-4120-b341-4f9e8ed9fe3b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:43.911584 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5ec71f2b-04bf-4120-b341-4f9e8ed9fe3b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:43.912572 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5ec71f2b-04bf-4120-b341-4f9e8ed9fe3b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:43.913590 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5ec71f2b-04bf-4120-b341-4f9e8ed9fe3b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:43.914263 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5ec71f2b-04bf-4120-b341-4f9e8ed9fe3b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:43.927583 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-13b21589-1103-4e0f-987f-73101a2c2b0e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:43.938364 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-13b21589-1103-4e0f-987f-73101a2c2b0e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1318 microversion: 2.1 time: 0.249292 Jan 10 11:38:43.938958 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 101/198] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:43 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:44.072327 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5ec71f2b-04bf-4120-b341-4f9e8ed9fe3b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:44.079853 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5ec71f2b-04bf-4120-b341-4f9e8ed9fe3b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.186670 Jan 10 11:38:44.080430 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 98/199] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:43 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:44.377927 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ada28b03-e602-4c08-842f-6aaaae6c41c7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:44.386263 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ff92d4a5-cefc-459a-acf5-545cba7b0c7c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:44.386683 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ff92d4a5-cefc-459a-acf5-545cba7b0c7c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:44.386890 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ada28b03-e602-4c08-842f-6aaaae6c41c7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:44.395832 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ff92d4a5-cefc-459a-acf5-545cba7b0c7c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:44.396615 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ff92d4a5-cefc-459a-acf5-545cba7b0c7c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:44.398378 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ff92d4a5-cefc-459a-acf5-545cba7b0c7c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:44.399414 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ff92d4a5-cefc-459a-acf5-545cba7b0c7c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:44.400811 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ada28b03-e602-4c08-842f-6aaaae6c41c7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:44.401465 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ada28b03-e602-4c08-842f-6aaaae6c41c7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:44.402776 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ada28b03-e602-4c08-842f-6aaaae6c41c7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:44.403303 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ada28b03-e602-4c08-842f-6aaaae6c41c7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:44.437913 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ff92d4a5-cefc-459a-acf5-545cba7b0c7c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Going to try to terminate instance {{(pid=128719) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:38:44.493851 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ada28b03-e602-4c08-842f-6aaaae6c41c7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 10009 microversion: 2.1 time: 0.119895 Jan 10 11:38:44.494579 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 102/200] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:44 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 10009 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:38:44.714546 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-70ad1bf4-250a-4093-8da4-ccbdc3639be1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:44.715580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-70ad1bf4-250a-4093-8da4-ccbdc3639be1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:44.723408 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-70ad1bf4-250a-4093-8da4-ccbdc3639be1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:44.724277 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-70ad1bf4-250a-4093-8da4-ccbdc3639be1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:44.725390 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-70ad1bf4-250a-4093-8da4-ccbdc3639be1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:44.726718 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-70ad1bf4-250a-4093-8da4-ccbdc3639be1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:44.818094 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-70ad1bf4-250a-4093-8da4-ccbdc3639be1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 14 microversion: 2.20 time: 0.108075 Jan 10 11:38:44.818794 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 103/201] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:44 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:44.824230 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-1b18103d-89e1-4c06-a23d-112a669ca437 req-4904111c-bb47-43a0-82b3-a9471c928161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dcee495-de1c-4d5b-9bee-3c6444b9094d", "tag": "1ecb83fe-4c4e-4c26-a55a-834028f08a68"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:44.825717 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:38:44.825717 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:38:44.837702 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-1b18103d-89e1-4c06-a23d-112a669ca437 req-4904111c-bb47-43a0-82b3-a9471c928161 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:44.837702 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-1b18103d-89e1-4c06-a23d-112a669ca437 req-4904111c-bb47-43a0-82b3-a9471c928161 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:44.847353 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-1b18103d-89e1-4c06-a23d-112a669ca437 req-4904111c-bb47-43a0-82b3-a9471c928161 service nova] Creating event network-changed:1ecb83fe-4c4e-4c26-a55a-834028f08a68 for instance 8dcee495-de1c-4d5b-9bee-3c6444b9094d on hv-cinder-maste Jan 10 11:38:44.852747 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-1b18103d-89e1-4c06-a23d-112a669ca437 req-4904111c-bb47-43a0-82b3-a9471c928161 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032224 Jan 10 11:38:44.853594 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 104/202] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:38:44.949586 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ff92d4a5-cefc-459a-acf5-545cba7b0c7c tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 204 len: 0 microversion: 2.1 time: 0.569023 Jan 10 11:38:44.969800 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-de26ef5f-323d-4220-a444-df6481fcbe2d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:44.970131 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 99/203] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:38:44 2022] DELETE /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 10 11:38:44.977650 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-de26ef5f-323d-4220-a444-df6481fcbe2d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:44.984193 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a6dc79a3-48d8-4989-b305-af035ff2a940 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:44.985585 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a6dc79a3-48d8-4989-b305-af035ff2a940 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:44.995838 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a6dc79a3-48d8-4989-b305-af035ff2a940 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:44.996895 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a6dc79a3-48d8-4989-b305-af035ff2a940 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:44.998405 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a6dc79a3-48d8-4989-b305-af035ff2a940 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:44.999732 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a6dc79a3-48d8-4989-b305-af035ff2a940 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:45.001459 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-de26ef5f-323d-4220-a444-df6481fcbe2d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:45.003513 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-de26ef5f-323d-4220-a444-df6481fcbe2d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:45.007647 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-de26ef5f-323d-4220-a444-df6481fcbe2d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:45.008458 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-de26ef5f-323d-4220-a444-df6481fcbe2d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:45.262508 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a6dc79a3-48d8-4989-b305-af035ff2a940 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:45.296062 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a6dc79a3-48d8-4989-b305-af035ff2a940 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1554 microversion: 2.1 time: 0.323448 Jan 10 11:38:45.296882 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 100/204] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:44 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1554 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:45.318822 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-de26ef5f-323d-4220-a444-df6481fcbe2d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:45.319064 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-86337e8c-a509-4160-9355-7c9eb842bdde tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:45.320590 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-86337e8c-a509-4160-9355-7c9eb842bdde tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:45.339705 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-86337e8c-a509-4160-9355-7c9eb842bdde tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:45.340042 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-86337e8c-a509-4160-9355-7c9eb842bdde tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:45.341074 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-86337e8c-a509-4160-9355-7c9eb842bdde tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:45.341896 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-86337e8c-a509-4160-9355-7c9eb842bdde tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:45.355360 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-de26ef5f-323d-4220-a444-df6481fcbe2d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1318 microversion: 2.1 time: 0.389652 Jan 10 11:38:45.367572 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 105/205] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:44 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:45.506965 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-409cb172-96a5-4514-94a6-a340eedd736e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:45.508435 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-409cb172-96a5-4514-94a6-a340eedd736e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:45.520832 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-409cb172-96a5-4514-94a6-a340eedd736e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:45.521614 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-409cb172-96a5-4514-94a6-a340eedd736e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:45.523825 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-409cb172-96a5-4514-94a6-a340eedd736e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:45.524636 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-409cb172-96a5-4514-94a6-a340eedd736e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:45.560225 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-86337e8c-a509-4160-9355-7c9eb842bdde tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:45.567891 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-86337e8c-a509-4160-9355-7c9eb842bdde tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.270133 Jan 10 11:38:45.568489 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 101/206] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:45 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:45.656831 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-409cb172-96a5-4514-94a6-a340eedd736e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 15064 microversion: 2.1 time: 0.153284 Jan 10 11:38:45.666580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 106/207] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:45 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 15064 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:38:45.841105 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-8fc465a7-2d39-4267-a446-ddd59ccf74c7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:45.842989 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-8fc465a7-2d39-4267-a446-ddd59ccf74c7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:45.849170 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8fc465a7-2d39-4267-a446-ddd59ccf74c7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:45.849858 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8fc465a7-2d39-4267-a446-ddd59ccf74c7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:45.851853 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8fc465a7-2d39-4267-a446-ddd59ccf74c7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:45.852330 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8fc465a7-2d39-4267-a446-ddd59ccf74c7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:45.946784 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-8fc465a7-2d39-4267-a446-ddd59ccf74c7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 8058 microversion: 2.20 time: 0.120528 Jan 10 11:38:45.947580 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 102/208] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:45 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 8058 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:38:46.316619 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-87d76480-c7aa-454a-aa81-19c1f0d96da5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:46.317475 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-87d76480-c7aa-454a-aa81-19c1f0d96da5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:46.324580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-87d76480-c7aa-454a-aa81-19c1f0d96da5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:46.325035 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-87d76480-c7aa-454a-aa81-19c1f0d96da5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:46.325820 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-87d76480-c7aa-454a-aa81-19c1f0d96da5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:46.326287 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-87d76480-c7aa-454a-aa81-19c1f0d96da5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:46.372882 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d2fde086-e013-46f4-878b-6186b3fb10c6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:46.373608 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d2fde086-e013-46f4-878b-6186b3fb10c6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:46.380577 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d2fde086-e013-46f4-878b-6186b3fb10c6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:46.381026 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d2fde086-e013-46f4-878b-6186b3fb10c6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:46.381815 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d2fde086-e013-46f4-878b-6186b3fb10c6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:46.382294 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d2fde086-e013-46f4-878b-6186b3fb10c6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:46.496852 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-87d76480-c7aa-454a-aa81-19c1f0d96da5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:46.507199 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-87d76480-c7aa-454a-aa81-19c1f0d96da5 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1554 microversion: 2.1 time: 0.194381 Jan 10 11:38:46.508509 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 107/209] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:46 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:46.572133 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-d2fde086-e013-46f4-878b-6186b3fb10c6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:46.580247 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d2fde086-e013-46f4-878b-6186b3fb10c6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1318 microversion: 2.1 time: 0.211371 Jan 10 11:38:46.580826 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 103/210] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:46 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:46.595271 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f3d95208-2896-4ffa-a0df-a282dd396037 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:46.595271 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f3d95208-2896-4ffa-a0df-a282dd396037 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:46.603619 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f3d95208-2896-4ffa-a0df-a282dd396037 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:46.604432 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f3d95208-2896-4ffa-a0df-a282dd396037 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:46.605807 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f3d95208-2896-4ffa-a0df-a282dd396037 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:46.606643 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f3d95208-2896-4ffa-a0df-a282dd396037 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:46.671450 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3d2ba930-5197-49a0-9b15-f17277073cc4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:46.672589 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-3d2ba930-5197-49a0-9b15-f17277073cc4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:46.680338 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3d2ba930-5197-49a0-9b15-f17277073cc4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:46.681350 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3d2ba930-5197-49a0-9b15-f17277073cc4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:46.682419 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3d2ba930-5197-49a0-9b15-f17277073cc4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:46.682877 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3d2ba930-5197-49a0-9b15-f17277073cc4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:46.774246 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3d2ba930-5197-49a0-9b15-f17277073cc4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 17000 microversion: 2.1 time: 0.107412 Jan 10 11:38:46.775536 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 104/211] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:46 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 17000 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:38:46.792487 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f3d95208-2896-4ffa-a0df-a282dd396037 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:46.802478 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f3d95208-2896-4ffa-a0df-a282dd396037 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.219777 Jan 10 11:38:46.803317 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 108/212] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:46 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:46.960180 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f1d0b553-dcab-4469-984e-3bea66b32527 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:46.961446 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f1d0b553-dcab-4469-984e-3bea66b32527 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:46.969390 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f1d0b553-dcab-4469-984e-3bea66b32527 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:46.969840 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f1d0b553-dcab-4469-984e-3bea66b32527 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:46.970671 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f1d0b553-dcab-4469-984e-3bea66b32527 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:46.971105 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f1d0b553-dcab-4469-984e-3bea66b32527 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:47.081289 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f1d0b553-dcab-4469-984e-3bea66b32527 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 11723 microversion: 2.20 time: 0.125790 Jan 10 11:38:47.081950 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 105/213] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:46 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 11723 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:38:47.528114 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2dfc85d1-e8c8-4ea9-b006-55447bc1a035 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:47.528940 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2dfc85d1-e8c8-4ea9-b006-55447bc1a035 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:47.535520 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2dfc85d1-e8c8-4ea9-b006-55447bc1a035 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:47.536484 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2dfc85d1-e8c8-4ea9-b006-55447bc1a035 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:47.536749 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2dfc85d1-e8c8-4ea9-b006-55447bc1a035 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:47.537190 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2dfc85d1-e8c8-4ea9-b006-55447bc1a035 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:47.609916 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2a6d7b04-e61e-4460-b568-146eefd74203 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:47.613335 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2a6d7b04-e61e-4460-b568-146eefd74203 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:47.629900 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a6d7b04-e61e-4460-b568-146eefd74203 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:47.637657 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a6d7b04-e61e-4460-b568-146eefd74203 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:47.638827 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a6d7b04-e61e-4460-b568-146eefd74203 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:47.642567 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a6d7b04-e61e-4460-b568-146eefd74203 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:47.782593 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2dfc85d1-e8c8-4ea9-b006-55447bc1a035 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:47.792858 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2dfc85d1-e8c8-4ea9-b006-55447bc1a035 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1554 microversion: 2.1 time: 0.272611 Jan 10 11:38:47.793668 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 109/214] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:47 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1554 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:47.798953 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a0ad3bc3-dd91-45b6-9170-1fcbafcc2e9c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:47.805216 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a0ad3bc3-dd91-45b6-9170-1fcbafcc2e9c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:47.809403 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a0ad3bc3-dd91-45b6-9170-1fcbafcc2e9c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:47.810186 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a0ad3bc3-dd91-45b6-9170-1fcbafcc2e9c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:47.811264 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a0ad3bc3-dd91-45b6-9170-1fcbafcc2e9c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:47.811927 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a0ad3bc3-dd91-45b6-9170-1fcbafcc2e9c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:47.871267 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2a6d7b04-e61e-4460-b568-146eefd74203 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:47.878846 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2a6d7b04-e61e-4460-b568-146eefd74203 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1318 microversion: 2.1 time: 0.281438 Jan 10 11:38:47.879441 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 106/215] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:47 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:47.884691 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-8c857e85-554a-48c9-adea-fa1b55930406 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:47.885290 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-8c857e85-554a-48c9-adea-fa1b55930406 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:47.891940 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8c857e85-554a-48c9-adea-fa1b55930406 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:47.892431 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8c857e85-554a-48c9-adea-fa1b55930406 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:47.893282 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8c857e85-554a-48c9-adea-fa1b55930406 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:47.894016 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8c857e85-554a-48c9-adea-fa1b55930406 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:47.907644 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a0ad3bc3-dd91-45b6-9170-1fcbafcc2e9c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 17686 microversion: 2.1 time: 0.112340 Jan 10 11:38:47.909315 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 110/216] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:47 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 17686 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:38:48.081796 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-8c857e85-554a-48c9-adea-fa1b55930406 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:48.090595 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-8c857e85-554a-48c9-adea-fa1b55930406 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.210052 Jan 10 11:38:48.091192 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 107/217] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:47 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:48.095842 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0b1953ff-3929-486a-aa31-8ca4196218e3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:48.097013 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0b1953ff-3929-486a-aa31-8ca4196218e3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:48.105260 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0b1953ff-3929-486a-aa31-8ca4196218e3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:48.106047 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0b1953ff-3929-486a-aa31-8ca4196218e3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:48.107220 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0b1953ff-3929-486a-aa31-8ca4196218e3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:48.107691 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0b1953ff-3929-486a-aa31-8ca4196218e3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:48.191954 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0b1953ff-3929-486a-aa31-8ca4196218e3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 15064 microversion: 2.20 time: 0.100810 Jan 10 11:38:48.192768 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 111/218] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:48 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 15064 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 11:38:48.598607 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-f65e5004-e2a2-4f5e-96fd-001f4b251dce req-ebbe7849-f624-4c9c-a23a-29c839376418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6353ce19-8a0e-4424-ab1f-d6e822696c00", "name": "network-vif-deleted", "tag": "0ea7b088-85a0-4b99-b5b6-5915fac5b55a"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:48.600245 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:38:48.600245 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:38:48.612246 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-f65e5004-e2a2-4f5e-96fd-001f4b251dce req-ebbe7849-f624-4c9c-a23a-29c839376418 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:48.613243 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-f65e5004-e2a2-4f5e-96fd-001f4b251dce req-ebbe7849-f624-4c9c-a23a-29c839376418 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:48.627237 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-f65e5004-e2a2-4f5e-96fd-001f4b251dce req-ebbe7849-f624-4c9c-a23a-29c839376418 service nova] Creating event network-vif-deleted:0ea7b088-85a0-4b99-b5b6-5915fac5b55a for instance 6353ce19-8a0e-4424-ab1f-d6e822696c00 on hv-cinder-maste Jan 10 11:38:48.632479 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-f65e5004-e2a2-4f5e-96fd-001f4b251dce req-ebbe7849-f624-4c9c-a23a-29c839376418 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037446 Jan 10 11:38:48.633396 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 108/219] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:38:48.820381 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-9f7701ea-44a2-46be-9c53-b89f481debbb tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:48.821259 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-9f7701ea-44a2-46be-9c53-b89f481debbb tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:48.829016 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9f7701ea-44a2-46be-9c53-b89f481debbb tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:48.829482 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9f7701ea-44a2-46be-9c53-b89f481debbb tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:48.830385 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9f7701ea-44a2-46be-9c53-b89f481debbb tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:48.831153 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9f7701ea-44a2-46be-9c53-b89f481debbb tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:48.897447 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a883e64d-4b5c-4ae9-b1ce-d96477b01b9c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:48.899041 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a883e64d-4b5c-4ae9-b1ce-d96477b01b9c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:48.906655 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a883e64d-4b5c-4ae9-b1ce-d96477b01b9c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:48.907111 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a883e64d-4b5c-4ae9-b1ce-d96477b01b9c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:48.907916 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a883e64d-4b5c-4ae9-b1ce-d96477b01b9c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:48.908385 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a883e64d-4b5c-4ae9-b1ce-d96477b01b9c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:48.931426 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-9f7701ea-44a2-46be-9c53-b89f481debbb tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:48.952448 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-9f7701ea-44a2-46be-9c53-b89f481debbb tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1346 microversion: 2.1 time: 0.136291 Jan 10 11:38:48.953463 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 112/220] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:48 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1346 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:48.963708 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2e4b7d77-657c-4f67-aec0-3ac22b4900ae tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:48.965306 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2e4b7d77-657c-4f67-aec0-3ac22b4900ae tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:48.976677 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2e4b7d77-657c-4f67-aec0-3ac22b4900ae tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:48.977419 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2e4b7d77-657c-4f67-aec0-3ac22b4900ae tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:48.978750 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2e4b7d77-657c-4f67-aec0-3ac22b4900ae tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:48.979378 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2e4b7d77-657c-4f67-aec0-3ac22b4900ae tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:49.127577 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a883e64d-4b5c-4ae9-b1ce-d96477b01b9c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:49.133923 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2e4b7d77-657c-4f67-aec0-3ac22b4900ae tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 19133 microversion: 2.1 time: 0.178123 Jan 10 11:38:49.135213 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 113/221] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:48 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 19133 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:38:49.135929 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a883e64d-4b5c-4ae9-b1ce-d96477b01b9c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1318 microversion: 2.1 time: 0.242520 Jan 10 11:38:49.145007 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-390356c0-e7f2-49ae-8f01-984588e8191b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:49.145007 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-390356c0-e7f2-49ae-8f01-984588e8191b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:49.145489 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 109/222] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:48 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:49.157984 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-390356c0-e7f2-49ae-8f01-984588e8191b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:49.159085 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-390356c0-e7f2-49ae-8f01-984588e8191b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:49.160161 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-390356c0-e7f2-49ae-8f01-984588e8191b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:49.160917 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-390356c0-e7f2-49ae-8f01-984588e8191b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:49.204647 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f24275f2-0476-4136-b087-67185c854b6c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:49.205709 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f24275f2-0476-4136-b087-67185c854b6c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:49.217556 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f24275f2-0476-4136-b087-67185c854b6c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:49.218828 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f24275f2-0476-4136-b087-67185c854b6c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:49.220487 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f24275f2-0476-4136-b087-67185c854b6c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:49.222433 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f24275f2-0476-4136-b087-67185c854b6c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:49.329686 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f24275f2-0476-4136-b087-67185c854b6c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 17659 microversion: 2.20 time: 0.129368 Jan 10 11:38:49.330883 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 110/223] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:49 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 17659 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:38:49.418399 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-390356c0-e7f2-49ae-8f01-984588e8191b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:49.426250 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-390356c0-e7f2-49ae-8f01-984588e8191b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.288913 Jan 10 11:38:49.426897 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 114/224] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:49 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:49.972061 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7a085f1b-9729-4141-8139-bb52c67f7556 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:49.972681 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7a085f1b-9729-4141-8139-bb52c67f7556 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:49.980788 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7a085f1b-9729-4141-8139-bb52c67f7556 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:49.981239 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7a085f1b-9729-4141-8139-bb52c67f7556 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:49.982350 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7a085f1b-9729-4141-8139-bb52c67f7556 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:49.982793 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7a085f1b-9729-4141-8139-bb52c67f7556 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:50.019553 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7a085f1b-9729-4141-8139-bb52c67f7556 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:50.020084 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7a085f1b-9729-4141-8139-bb52c67f7556 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:50.020566 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-7a085f1b-9729-4141-8139-bb52c67f7556 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lazy-loading 'fault' on Instance uuid 6353ce19-8a0e-4424-ab1f-d6e822696c00 {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:38:50.068969 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-7a085f1b-9729-4141-8139-bb52c67f7556 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:50.080046 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7a085f1b-9729-4141-8139-bb52c67f7556 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1351 microversion: 2.1 time: 0.111975 Jan 10 11:38:50.083002 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 111/225] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:49 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:50.147132 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3557a5f8-4e67-41f2-bb86-343660f3d542 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:50.150277 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3557a5f8-4e67-41f2-bb86-343660f3d542 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:50.155268 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-6d8eb91f-e44f-4f03-88d3-429ad27c098b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:50.156175 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-6d8eb91f-e44f-4f03-88d3-429ad27c098b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:50.157049 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3557a5f8-4e67-41f2-bb86-343660f3d542 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:50.157636 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3557a5f8-4e67-41f2-bb86-343660f3d542 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:50.158481 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3557a5f8-4e67-41f2-bb86-343660f3d542 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:50.159090 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3557a5f8-4e67-41f2-bb86-343660f3d542 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:50.167183 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6d8eb91f-e44f-4f03-88d3-429ad27c098b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:50.167881 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6d8eb91f-e44f-4f03-88d3-429ad27c098b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:50.169160 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6d8eb91f-e44f-4f03-88d3-429ad27c098b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:50.169943 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6d8eb91f-e44f-4f03-88d3-429ad27c098b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:50.347623 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-6d8eb91f-e44f-4f03-88d3-429ad27c098b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:50.358007 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-6d8eb91f-e44f-4f03-88d3-429ad27c098b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1318 microversion: 2.1 time: 0.207824 Jan 10 11:38:50.358643 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 112/226] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:50 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:50.365386 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b7b31848-ac7e-4c1e-9ea6-89e73cb27982 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:50.366648 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b7b31848-ac7e-4c1e-9ea6-89e73cb27982 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:50.375271 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b7b31848-ac7e-4c1e-9ea6-89e73cb27982 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:50.376061 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b7b31848-ac7e-4c1e-9ea6-89e73cb27982 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:50.377502 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b7b31848-ac7e-4c1e-9ea6-89e73cb27982 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:50.377976 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b7b31848-ac7e-4c1e-9ea6-89e73cb27982 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:52.289659 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b7b31848-ac7e-4c1e-9ea6-89e73cb27982 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 19342 microversion: 2.20 time: 1.929251 Jan 10 11:38:52.290841 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 113/227] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:50 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 19342 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:38:52.299419 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b38c091d-012b-489a-8ed0-e93f6a86bd24 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:52.300653 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b38c091d-012b-489a-8ed0-e93f6a86bd24 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:52.307661 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3557a5f8-4e67-41f2-bb86-343660f3d542 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 22496 microversion: 2.1 time: 2.164523 Jan 10 11:38:52.312596 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 115/228] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:50 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 22496 bytes in 2170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:38:52.313153 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b38c091d-012b-489a-8ed0-e93f6a86bd24 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:52.313642 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b38c091d-012b-489a-8ed0-e93f6a86bd24 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:52.314490 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b38c091d-012b-489a-8ed0-e93f6a86bd24 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:52.319400 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b38c091d-012b-489a-8ed0-e93f6a86bd24 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:52.330742 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-235d13c1-b91a-4932-bf9b-b03f2187fe3f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:52.342273 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-235d13c1-b91a-4932-bf9b-b03f2187fe3f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:52.357333 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-235d13c1-b91a-4932-bf9b-b03f2187fe3f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:52.357333 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-235d13c1-b91a-4932-bf9b-b03f2187fe3f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:52.357333 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-235d13c1-b91a-4932-bf9b-b03f2187fe3f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:52.358062 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-235d13c1-b91a-4932-bf9b-b03f2187fe3f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:52.441300 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-235d13c1-b91a-4932-bf9b-b03f2187fe3f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:52.445546 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-235d13c1-b91a-4932-bf9b-b03f2187fe3f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:52.445546 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.objects.instance [None req-235d13c1-b91a-4932-bf9b-b03f2187fe3f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lazy-loading 'fault' on Instance uuid 6353ce19-8a0e-4424-ab1f-d6e822696c00 {{(pid=128718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:38:52.484067 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-b38c091d-012b-489a-8ed0-e93f6a86bd24 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:52.496227 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b38c091d-012b-489a-8ed0-e93f6a86bd24 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.203810 Jan 10 11:38:52.496834 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 114/229] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:52 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:52.509251 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-0cddcc98-7350-4863-a3ce-c2eafdc1ac3f tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:52.509902 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-0cddcc98-7350-4863-a3ce-c2eafdc1ac3f tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:52.517035 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0cddcc98-7350-4863-a3ce-c2eafdc1ac3f tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:52.517518 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0cddcc98-7350-4863-a3ce-c2eafdc1ac3f tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:52.519070 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0cddcc98-7350-4863-a3ce-c2eafdc1ac3f tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:52.519783 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0cddcc98-7350-4863-a3ce-c2eafdc1ac3f tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:52.520749 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-235d13c1-b91a-4932-bf9b-b03f2187fe3f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa7971d6f99464bbe62c60e318cf414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd16126432b64642b65fa0a3d8bd7043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:52.537837 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-235d13c1-b91a-4932-bf9b-b03f2187fe3f tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 200 len: 1351 microversion: 2.1 time: 0.222796 Jan 10 11:38:52.554079 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 116/230] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:52 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 1351 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:52.685973 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-0cddcc98-7350-4863-a3ce-c2eafdc1ac3f tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:52.694994 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-0cddcc98-7350-4863-a3ce-c2eafdc1ac3f tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1318 microversion: 2.1 time: 0.196508 Jan 10 11:38:52.701765 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 115/231] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:52 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:53.301321 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-5a5af3af-f873-4070-94f6-0a354edcb0be tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:53.302315 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-5a5af3af-f873-4070-94f6-0a354edcb0be tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:53.310010 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5a5af3af-f873-4070-94f6-0a354edcb0be tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:53.310658 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5a5af3af-f873-4070-94f6-0a354edcb0be tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:53.311323 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5a5af3af-f873-4070-94f6-0a354edcb0be tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:53.311770 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5a5af3af-f873-4070-94f6-0a354edcb0be tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:53.321125 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-8963a176-c6fb-454a-a817-530e114c8750 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:53.322080 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-8963a176-c6fb-454a-a817-530e114c8750 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:53.328517 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8963a176-c6fb-454a-a817-530e114c8750 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:53.329684 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8963a176-c6fb-454a-a817-530e114c8750 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:53.330692 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8963a176-c6fb-454a-a817-530e114c8750 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:53.331282 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8963a176-c6fb-454a-a817-530e114c8750 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:53.407375 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-5a5af3af-f873-4070-94f6-0a354edcb0be tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 21287 microversion: 2.20 time: 0.109909 Jan 10 11:38:53.408049 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 117/232] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:53 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 21287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:38:53.436957 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-8963a176-c6fb-454a-a817-530e114c8750 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 23228 microversion: 2.1 time: 0.120091 Jan 10 11:38:53.438246 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 116/233] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:53 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 23228 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:38:53.516463 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b3e07540-aca7-48aa-8e84-79b5d8813a75 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:53.517682 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b3e07540-aca7-48aa-8e84-79b5d8813a75 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:53.525354 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b3e07540-aca7-48aa-8e84-79b5d8813a75 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:53.525866 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b3e07540-aca7-48aa-8e84-79b5d8813a75 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:53.526690 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b3e07540-aca7-48aa-8e84-79b5d8813a75 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:53.527080 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b3e07540-aca7-48aa-8e84-79b5d8813a75 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:53.567490 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7e5f6e43-86b9-48ca-b384-8ee2c85db112 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:53.567801 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7e5f6e43-86b9-48ca-b384-8ee2c85db112 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:53.577338 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7e5f6e43-86b9-48ca-b384-8ee2c85db112 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:53.578110 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7e5f6e43-86b9-48ca-b384-8ee2c85db112 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:53.579161 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7e5f6e43-86b9-48ca-b384-8ee2c85db112 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:53.579637 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7e5f6e43-86b9-48ca-b384-8ee2c85db112 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:53.599767 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-7e5f6e43-86b9-48ca-b384-8ee2c85db112 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] HTTP exception thrown: Instance 6353ce19-8a0e-4424-ab1f-d6e822696c00 could not be found. Jan 10 11:38:53.602130 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7e5f6e43-86b9-48ca-b384-8ee2c85db112 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Returning 404 to user: Instance 6353ce19-8a0e-4424-ab1f-d6e822696c00 could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:38:53.620124 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7e5f6e43-86b9-48ca-b384-8ee2c85db112 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 404 len: 111 microversion: 2.1 time: 0.041756 Jan 10 11:38:53.620124 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 117/234] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:53 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 10 11:38:53.679934 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b3e07540-aca7-48aa-8e84-79b5d8813a75 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:53.691094 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b3e07540-aca7-48aa-8e84-79b5d8813a75 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1519 microversion: 2.1 time: 0.179506 Jan 10 11:38:53.691950 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 118/235] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:53 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:53.719581 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-14f0d360-17a1-4c6c-821d-d9b294f99e4a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:53.720202 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-14f0d360-17a1-4c6c-821d-d9b294f99e4a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:53.728143 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-14f0d360-17a1-4c6c-821d-d9b294f99e4a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:53.732644 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-14f0d360-17a1-4c6c-821d-d9b294f99e4a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:53.732644 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-14f0d360-17a1-4c6c-821d-d9b294f99e4a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:53.732644 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-14f0d360-17a1-4c6c-821d-d9b294f99e4a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:53.917520 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-14f0d360-17a1-4c6c-821d-d9b294f99e4a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:53.928641 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-14f0d360-17a1-4c6c-821d-d9b294f99e4a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1318 microversion: 2.1 time: 0.214686 Jan 10 11:38:53.931070 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 118/236] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:53 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:53.974081 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7281b598-5df2-4809-9101-28e412486962 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:53.975039 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7281b598-5df2-4809-9101-28e412486962 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:53.982811 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7281b598-5df2-4809-9101-28e412486962 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:53.983268 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7281b598-5df2-4809-9101-28e412486962 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:53.984076 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7281b598-5df2-4809-9101-28e412486962 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:53.984519 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7281b598-5df2-4809-9101-28e412486962 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:54.000303 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-7281b598-5df2-4809-9101-28e412486962 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] HTTP exception thrown: Instance 6353ce19-8a0e-4424-ab1f-d6e822696c00 could not be found. Jan 10 11:38:54.000914 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7281b598-5df2-4809-9101-28e412486962 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Returning 404 to user: Instance 6353ce19-8a0e-4424-ab1f-d6e822696c00 could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:38:54.001767 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7281b598-5df2-4809-9101-28e412486962 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031690 Jan 10 11:38:54.002679 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 119/237] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:38:53 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:38:54.420921 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-62cd701a-9589-4b24-8bb3-7a9f549c6506 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:54.421842 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-62cd701a-9589-4b24-8bb3-7a9f549c6506 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:54.436089 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-62cd701a-9589-4b24-8bb3-7a9f549c6506 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:54.436659 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-62cd701a-9589-4b24-8bb3-7a9f549c6506 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:54.437858 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-62cd701a-9589-4b24-8bb3-7a9f549c6506 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:54.438376 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-62cd701a-9589-4b24-8bb3-7a9f549c6506 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:54.452435 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4003fe77-c4a9-4d63-906e-4f6e9f3da604 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:54.454036 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4003fe77-c4a9-4d63-906e-4f6e9f3da604 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:54.461156 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4003fe77-c4a9-4d63-906e-4f6e9f3da604 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:54.462397 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4003fe77-c4a9-4d63-906e-4f6e9f3da604 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:54.470127 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4003fe77-c4a9-4d63-906e-4f6e9f3da604 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:54.473636 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4003fe77-c4a9-4d63-906e-4f6e9f3da604 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:54.540046 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-62cd701a-9589-4b24-8bb3-7a9f549c6506 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 22714 microversion: 2.20 time: 0.122600 Jan 10 11:38:54.544035 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 119/238] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:54 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 22714 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:38:54.589374 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4003fe77-c4a9-4d63-906e-4f6e9f3da604 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 24289 microversion: 2.1 time: 0.141312 Jan 10 11:38:54.590268 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 120/239] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:54 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 24289 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:38:54.714128 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5502832f-f647-45cb-8f12-0e371b76e9d9 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:54.716145 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5502832f-f647-45cb-8f12-0e371b76e9d9 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:54.730153 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5502832f-f647-45cb-8f12-0e371b76e9d9 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:54.731057 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5502832f-f647-45cb-8f12-0e371b76e9d9 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:54.733042 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5502832f-f647-45cb-8f12-0e371b76e9d9 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:54.733773 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5502832f-f647-45cb-8f12-0e371b76e9d9 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:54.942288 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5502832f-f647-45cb-8f12-0e371b76e9d9 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:54.952960 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5502832f-f647-45cb-8f12-0e371b76e9d9 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1499 microversion: 2.1 time: 0.247644 Jan 10 11:38:54.953874 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 120/240] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:54 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1499 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:54.959343 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-28fc603e-c6c5-47ab-8c79-c5c01f41778a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:54.960097 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-28fc603e-c6c5-47ab-8c79-c5c01f41778a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:54.968934 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-28fc603e-c6c5-47ab-8c79-c5c01f41778a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:54.969410 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-28fc603e-c6c5-47ab-8c79-c5c01f41778a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:54.970370 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-28fc603e-c6c5-47ab-8c79-c5c01f41778a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:54.970817 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-28fc603e-c6c5-47ab-8c79-c5c01f41778a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:54.985951 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2a0a02f2-cdf0-4868-b03b-3426bb0581a1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:54.987954 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2a0a02f2-cdf0-4868-b03b-3426bb0581a1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:54.999920 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a0a02f2-cdf0-4868-b03b-3426bb0581a1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:55.000685 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a0a02f2-cdf0-4868-b03b-3426bb0581a1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:55.002124 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a0a02f2-cdf0-4868-b03b-3426bb0581a1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:55.002886 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a0a02f2-cdf0-4868-b03b-3426bb0581a1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:55.307921 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-28fc603e-c6c5-47ab-8c79-c5c01f41778a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:55.315844 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-28fc603e-c6c5-47ab-8c79-c5c01f41778a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1318 microversion: 2.1 time: 0.371261 Jan 10 11:38:55.316436 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 121/241] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:54 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:55.321422 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-bb60a3a4-fb06-44eb-9e8f-eb3128780d2f req-9353317e-46b8-4914-be57-81ca68562f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dcee495-de1c-4d5b-9bee-3c6444b9094d", "name": "network-vif-plugged", "status": "completed", "tag": "1ecb83fe-4c4e-4c26-a55a-834028f08a68"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:55.321646 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2a0a02f2-cdf0-4868-b03b-3426bb0581a1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:55.323095 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:38:55.323095 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:38:55.330649 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-bb60a3a4-fb06-44eb-9e8f-eb3128780d2f req-9353317e-46b8-4914-be57-81ca68562f75 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:55.330894 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2a0a02f2-cdf0-4868-b03b-3426bb0581a1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1516 microversion: 2.1 time: 0.352772 Jan 10 11:38:55.331099 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-bb60a3a4-fb06-44eb-9e8f-eb3128780d2f req-9353317e-46b8-4914-be57-81ca68562f75 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:55.331624 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 121/242] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:54 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1516 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:55.344886 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-bb60a3a4-fb06-44eb-9e8f-eb3128780d2f req-9353317e-46b8-4914-be57-81ca68562f75 service nova] Creating event network-vif-plugged:1ecb83fe-4c4e-4c26-a55a-834028f08a68 for instance 8dcee495-de1c-4d5b-9bee-3c6444b9094d on hv-cinder-maste Jan 10 11:38:55.350334 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-bb60a3a4-fb06-44eb-9e8f-eb3128780d2f req-9353317e-46b8-4914-be57-81ca68562f75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032720 Jan 10 11:38:55.352069 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 122/243] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:38:55.554989 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7e41db65-1f4d-41e4-9989-3ab68d12e6db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:55.555856 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7e41db65-1f4d-41e4-9989-3ab68d12e6db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:55.563608 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7e41db65-1f4d-41e4-9989-3ab68d12e6db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:55.564036 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7e41db65-1f4d-41e4-9989-3ab68d12e6db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:55.564841 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7e41db65-1f4d-41e4-9989-3ab68d12e6db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:55.565379 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7e41db65-1f4d-41e4-9989-3ab68d12e6db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:55.620557 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-805b4388-4a92-4704-8507-fb33e85f9a57 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:55.624312 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-805b4388-4a92-4704-8507-fb33e85f9a57 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:55.636026 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-805b4388-4a92-4704-8507-fb33e85f9a57 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:55.636864 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-805b4388-4a92-4704-8507-fb33e85f9a57 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:55.639621 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-805b4388-4a92-4704-8507-fb33e85f9a57 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:55.640458 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-805b4388-4a92-4704-8507-fb33e85f9a57 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:55.671345 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7e41db65-1f4d-41e4-9989-3ab68d12e6db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 23802 microversion: 2.20 time: 0.122187 Jan 10 11:38:55.672317 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 122/244] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:55 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 23802 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:38:55.737775 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-805b4388-4a92-4704-8507-fb33e85f9a57 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 25395 microversion: 2.1 time: 0.139774 Jan 10 11:38:55.738479 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 123/245] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:55 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 25395 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:38:56.125533 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b849f4f9-6437-4a62-9e6f-bdaa74c32700 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1974826664", "imageRef": "b6e63192-9c33-4d80-9555-6de2bb10fd32", "flavorRef": "452"}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:56.183441 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.network.neutron [None req-b849f4f9-6437-4a62-9e6f-bdaa74c32700 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] validate_networks() for None {{(pid=128719) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:38:56.337466 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-daba0ff0-4a95-4d12-940e-b2e98717379c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:56.338185 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-daba0ff0-4a95-4d12-940e-b2e98717379c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:56.346151 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-daba0ff0-4a95-4d12-940e-b2e98717379c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:56.346649 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-daba0ff0-4a95-4d12-940e-b2e98717379c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:56.347444 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-daba0ff0-4a95-4d12-940e-b2e98717379c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:56.347939 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-daba0ff0-4a95-4d12-940e-b2e98717379c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:56.565644 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-b849f4f9-6437-4a62-9e6f-bdaa74c32700 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Flavor limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:38:56.567918 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-b849f4f9-6437-4a62-9e6f-bdaa74c32700 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Image limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:38:56.569135 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-b849f4f9-6437-4a62-9e6f-bdaa74c32700 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Flavor pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:38:56.570324 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-b849f4f9-6437-4a62-9e6f-bdaa74c32700 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Image pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:38:56.571075 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-b849f4f9-6437-4a62-9e6f-bdaa74c32700 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:38:56.591199 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b849f4f9-6437-4a62-9e6f-bdaa74c32700 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:56.592133 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b849f4f9-6437-4a62-9e6f-bdaa74c32700 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:56.597060 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b849f4f9-6437-4a62-9e6f-bdaa74c32700 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:56.597060 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b849f4f9-6437-4a62-9e6f-bdaa74c32700 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:56.605639 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-daba0ff0-4a95-4d12-940e-b2e98717379c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:56.621847 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-daba0ff0-4a95-4d12-940e-b2e98717379c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1318 microversion: 2.1 time: 0.289692 Jan 10 11:38:56.622873 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 124/246] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:56 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:56.628649 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-b849f4f9-6437-4a62-9e6f-bdaa74c32700 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Getting quotas for project 51d2f537a79a40f793f17573c3c26ba7. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:38:56.634078 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-b849f4f9-6437-4a62-9e6f-bdaa74c32700 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Getting quotas for user fbbc21f8524046df82e09f3e5628213e and project 51d2f537a79a40f793f17573c3c26ba7. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:38:56.634950 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-cd6708c8-6877-44c8-a7a2-bfb1981f28ef tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:56.635463 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-cd6708c8-6877-44c8-a7a2-bfb1981f28ef tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:56.641624 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cd6708c8-6877-44c8-a7a2-bfb1981f28ef tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:56.642081 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cd6708c8-6877-44c8-a7a2-bfb1981f28ef tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:56.643042 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cd6708c8-6877-44c8-a7a2-bfb1981f28ef tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:56.643487 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cd6708c8-6877-44c8-a7a2-bfb1981f28ef tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:56.645865 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b849f4f9-6437-4a62-9e6f-bdaa74c32700 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Going to run 1 instances... {{(pid=128719) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:38:56.648218 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b849f4f9-6437-4a62-9e6f-bdaa74c32700 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e63192-9c33-4d80-9555-6de2bb10fd32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:38:56.657399 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-cd6708c8-6877-44c8-a7a2-bfb1981f28ef tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] HTTP exception thrown: Instance 6353ce19-8a0e-4424-ab1f-d6e822696c00 could not be found. Jan 10 11:38:56.657997 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-cd6708c8-6877-44c8-a7a2-bfb1981f28ef tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Returning 404 to user: Instance 6353ce19-8a0e-4424-ab1f-d6e822696c00 could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:38:56.658865 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-cd6708c8-6877-44c8-a7a2-bfb1981f28ef tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 404 len: 111 microversion: 2.1 time: 0.028126 Jan 10 11:38:56.659612 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 125/247] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:38:56 2022] DELETE /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:38:56.672606 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-09a3896e-d90f-4aab-8e53-7d317be0e8c9 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:56.673222 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-09a3896e-d90f-4aab-8e53-7d317be0e8c9 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] [instance: 6353ce19-8a0e-4424-ab1f-d6e822696c00] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:56.682771 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-09a3896e-d90f-4aab-8e53-7d317be0e8c9 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:56.683576 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-09a3896e-d90f-4aab-8e53-7d317be0e8c9 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:56.684688 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-09a3896e-d90f-4aab-8e53-7d317be0e8c9 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:56.685281 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-09a3896e-d90f-4aab-8e53-7d317be0e8c9 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:56.702613 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-09a3896e-d90f-4aab-8e53-7d317be0e8c9 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] HTTP exception thrown: Instance 6353ce19-8a0e-4424-ab1f-d6e822696c00 could not be found. Jan 10 11:38:56.703227 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-09a3896e-d90f-4aab-8e53-7d317be0e8c9 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] Returning 404 to user: Instance 6353ce19-8a0e-4424-ab1f-d6e822696c00 could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:38:56.704057 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-09a3896e-d90f-4aab-8e53-7d317be0e8c9 tempest-DeleteServersTestJSON-261732279 tempest-DeleteServersTestJSON-261732279-project] 10.222.0.20 "GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00" status: 404 len: 111 microversion: 2.1 time: 0.035398 Jan 10 11:38:56.705842 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 126/248] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:56 2022] GET /compute/v2.1/servers/6353ce19-8a0e-4424-ab1f-d6e822696c00 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 10 11:38:56.709062 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-fe3be16a-65db-4574-bf0f-dfb45bf77a89 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:56.709981 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-fe3be16a-65db-4574-bf0f-dfb45bf77a89 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:56.717238 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fe3be16a-65db-4574-bf0f-dfb45bf77a89 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:56.717698 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fe3be16a-65db-4574-bf0f-dfb45bf77a89 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:56.718522 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fe3be16a-65db-4574-bf0f-dfb45bf77a89 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:56.718971 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fe3be16a-65db-4574-bf0f-dfb45bf77a89 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:56.810940 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-fe3be16a-65db-4574-bf0f-dfb45bf77a89 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 24751 microversion: 2.20 time: 0.104552 Jan 10 11:38:56.813172 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 127/249] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:56 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 24751 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:38:56.825108 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c344c3b6-6473-45e8-adeb-342e70fdbff8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:56.827687 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c344c3b6-6473-45e8-adeb-342e70fdbff8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:56.841166 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b849f4f9-6437-4a62-9e6f-bdaa74c32700 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719794 Jan 10 11:38:56.842132 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 123/250] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:38:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 11:38:56.848521 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c344c3b6-6473-45e8-adeb-342e70fdbff8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:56.849323 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c344c3b6-6473-45e8-adeb-342e70fdbff8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:56.850782 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c344c3b6-6473-45e8-adeb-342e70fdbff8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:56.851952 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c344c3b6-6473-45e8-adeb-342e70fdbff8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:56.858409 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-57c6d64b-97bc-41a5-8e36-a2d2227a0d05 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:56.859375 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-57c6d64b-97bc-41a5-8e36-a2d2227a0d05 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:56.964202 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-57c6d64b-97bc-41a5-8e36-a2d2227a0d05 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:56.966818 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c344c3b6-6473-45e8-adeb-342e70fdbff8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 26279 microversion: 2.1 time: 0.151105 Jan 10 11:38:56.968465 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 128/251] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:56 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 26279 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:38:56.972651 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-57c6d64b-97bc-41a5-8e36-a2d2227a0d05 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1215 microversion: 2.1 time: 0.118221 Jan 10 11:38:56.973357 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 124/252] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:56 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:57.641592 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-9fcab394-693e-482a-8402-d39a46413011 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:57.642519 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-9fcab394-693e-482a-8402-d39a46413011 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:57.650869 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9fcab394-693e-482a-8402-d39a46413011 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:57.651345 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9fcab394-693e-482a-8402-d39a46413011 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:57.652243 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9fcab394-693e-482a-8402-d39a46413011 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:57.652721 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9fcab394-693e-482a-8402-d39a46413011 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:57.807637 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-9fcab394-693e-482a-8402-d39a46413011 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:57.822547 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-9fcab394-693e-482a-8402-d39a46413011 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1318 microversion: 2.1 time: 0.184941 Jan 10 11:38:57.823877 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 129/253] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:57 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:57.826926 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3f2ec5b4-6c64-4ea2-a4a6-500e06e0007d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:57.827972 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-3f2ec5b4-6c64-4ea2-a4a6-500e06e0007d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:57.846509 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3f2ec5b4-6c64-4ea2-a4a6-500e06e0007d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:57.846509 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3f2ec5b4-6c64-4ea2-a4a6-500e06e0007d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:57.846509 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3f2ec5b4-6c64-4ea2-a4a6-500e06e0007d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:57.846509 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3f2ec5b4-6c64-4ea2-a4a6-500e06e0007d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:57.933903 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3f2ec5b4-6c64-4ea2-a4a6-500e06e0007d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 25384 microversion: 2.20 time: 0.112834 Jan 10 11:38:57.951709 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 125/254] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:57 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 25384 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 11:38:57.980397 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-22f9f58d-7c55-480f-be38-9eafbe3e9932 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:57.981349 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-22f9f58d-7c55-480f-be38-9eafbe3e9932 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:57.989533 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-22f9f58d-7c55-480f-be38-9eafbe3e9932 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:57.989992 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-22f9f58d-7c55-480f-be38-9eafbe3e9932 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:57.990882 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-22f9f58d-7c55-480f-be38-9eafbe3e9932 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:57.991425 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-22f9f58d-7c55-480f-be38-9eafbe3e9932 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:57.994100 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-0941b297-e092-4a4a-997f-c5f4a5b9c7b5 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:57.994868 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-0941b297-e092-4a4a-997f-c5f4a5b9c7b5 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:58.058491 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-0941b297-e092-4a4a-997f-c5f4a5b9c7b5 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:58.066140 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-0941b297-e092-4a4a-997f-c5f4a5b9c7b5 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1215 microversion: 2.1 time: 0.077559 Jan 10 11:38:58.067272 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 126/255] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:57 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1215 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:58.082772 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-22f9f58d-7c55-480f-be38-9eafbe3e9932 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 26840 microversion: 2.1 time: 0.106659 Jan 10 11:38:58.083528 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 130/256] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:57 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 26840 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:38:58.191427 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-36ff6f12-b85f-441a-b239-7d3e40da6918 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:58.192526 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-36ff6f12-b85f-441a-b239-7d3e40da6918 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:58.200159 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-36ff6f12-b85f-441a-b239-7d3e40da6918 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:58.200608 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-36ff6f12-b85f-441a-b239-7d3e40da6918 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:58.201415 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-36ff6f12-b85f-441a-b239-7d3e40da6918 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:58.201859 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-36ff6f12-b85f-441a-b239-7d3e40da6918 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:58.228119 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-36ff6f12-b85f-441a-b239-7d3e40da6918 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lazy-loading 'flavor' on Instance uuid 9bb75a87-2b05-43d3-b570-a04858874b50 {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:38:58.794237 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-36ff6f12-b85f-441a-b239-7d3e40da6918 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "POST /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/action" status: 200 len: 32 microversion: 2.1 time: 0.610441 Jan 10 11:38:58.800220 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 127/257] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:58 2022] POST /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/action => generated 32 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 10 11:38:58.805690 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0e2696f4-d8b2-4b69-b8e4-b86b816db16c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:58.806463 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0e2696f4-d8b2-4b69-b8e4-b86b816db16c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:58.814160 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e2696f4-d8b2-4b69-b8e4-b86b816db16c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:58.814669 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e2696f4-d8b2-4b69-b8e4-b86b816db16c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:58.815351 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e2696f4-d8b2-4b69-b8e4-b86b816db16c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:58.815790 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e2696f4-d8b2-4b69-b8e4-b86b816db16c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:58.847184 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-61327a7f-c68a-4dc3-84ce-cd721300c42c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:58.848125 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-61327a7f-c68a-4dc3-84ce-cd721300c42c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:58.865170 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-61327a7f-c68a-4dc3-84ce-cd721300c42c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:58.865645 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-61327a7f-c68a-4dc3-84ce-cd721300c42c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:58.866544 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-61327a7f-c68a-4dc3-84ce-cd721300c42c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:58.866993 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-61327a7f-c68a-4dc3-84ce-cd721300c42c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:59.018076 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0e2696f4-d8b2-4b69-b8e4-b86b816db16c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:59.035074 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0e2696f4-d8b2-4b69-b8e4-b86b816db16c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.231815 Jan 10 11:38:59.036758 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 131/258] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:58 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:59.060798 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ce83461c-a825-44ab-adb4-70d01bbdd26c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:59.061838 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ce83461c-a825-44ab-adb4-70d01bbdd26c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:59.068406 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ce83461c-a825-44ab-adb4-70d01bbdd26c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:59.070716 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ce83461c-a825-44ab-adb4-70d01bbdd26c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:59.071099 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ce83461c-a825-44ab-adb4-70d01bbdd26c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:59.071971 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ce83461c-a825-44ab-adb4-70d01bbdd26c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:59.087527 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-61327a7f-c68a-4dc3-84ce-cd721300c42c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:59.109161 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-61327a7f-c68a-4dc3-84ce-cd721300c42c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1507 microversion: 2.1 time: 0.263258 Jan 10 11:38:59.109161 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 128/259] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:58 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1507 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:38:59.121372 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-17de233e-2fd9-48d9-9256-238b37790cb3 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:59.122085 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-17de233e-2fd9-48d9-9256-238b37790cb3 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:59.185208 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-17de233e-2fd9-48d9-9256-238b37790cb3 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:38:59.188739 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ce83461c-a825-44ab-adb4-70d01bbdd26c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 26259 microversion: 2.20 time: 0.130097 Jan 10 11:38:59.192589 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-17de233e-2fd9-48d9-9256-238b37790cb3 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1215 microversion: 2.1 time: 0.081750 Jan 10 11:38:59.193542 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 132/260] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:38:59 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 26259 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:38:59.206417 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 129/261] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:38:59 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:38:59.209788 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-364e127f-289e-4eee-829e-7f901c311493 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:59.210174 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-0dedf7b5-e3bc-4415-ad8e-d8011602f0ed tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ad41d90-2cec-47d9-8e2f-c6bf2ee396d8"}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:38:59.211315 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-0dedf7b5-e3bc-4415-ad8e-d8011602f0ed tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:59.214144 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-364e127f-289e-4eee-829e-7f901c311493 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:59.217718 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0dedf7b5-e3bc-4415-ad8e-d8011602f0ed tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:59.218142 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0dedf7b5-e3bc-4415-ad8e-d8011602f0ed tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:59.219038 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0dedf7b5-e3bc-4415-ad8e-d8011602f0ed tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:59.219471 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0dedf7b5-e3bc-4415-ad8e-d8011602f0ed tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:59.247041 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-364e127f-289e-4eee-829e-7f901c311493 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:59.248047 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-364e127f-289e-4eee-829e-7f901c311493 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:59.251173 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-364e127f-289e-4eee-829e-7f901c311493 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:59.251621 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-364e127f-289e-4eee-829e-7f901c311493 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:59.360501 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-0dedf7b5-e3bc-4415-ad8e-d8011602f0ed tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] HTTP exception thrown: Invalid volume: volume 4ad41d90-2cec-47d9-8e2f-c6bf2ee396d8 is already attached to instances: 17641f31-456c-4c0f-8f40-5337b16bc6e0 Jan 10 11:38:59.361360 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-0dedf7b5-e3bc-4415-ad8e-d8011602f0ed tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Returning 400 to user: Invalid volume: volume 4ad41d90-2cec-47d9-8e2f-c6bf2ee396d8 is already attached to instances: 17641f31-456c-4c0f-8f40-5337b16bc6e0 {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:38:59.362393 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-0dedf7b5-e3bc-4415-ad8e-d8011602f0ed tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "POST /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.156047 Jan 10 11:38:59.367628 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 130/262] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jan 10 11:38:59 2022] POST /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d/os-volume_attachments => generated 174 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 10 11:38:59.392023 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-364e127f-289e-4eee-829e-7f901c311493 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 27422 microversion: 2.1 time: 0.192524 Jan 10 11:38:59.393829 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 133/263] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:38:59 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 27422 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:38:59.438923 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ade0a93b-9261-4a1e-b1f0-453127439d5a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:38:59.439792 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ade0a93b-9261-4a1e-b1f0-453127439d5a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:38:59.449878 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ade0a93b-9261-4a1e-b1f0-453127439d5a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:59.449878 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ade0a93b-9261-4a1e-b1f0-453127439d5a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:59.451824 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ade0a93b-9261-4a1e-b1f0-453127439d5a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:38:59.452542 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ade0a93b-9261-4a1e-b1f0-453127439d5a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:38:59.653651 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-ade0a93b-9261-4a1e-b1f0-453127439d5a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lazy-loading 'services' on Instance uuid 17641f31-456c-4c0f-8f40-5337b16bc6e0 {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:39:00.062253 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ade0a93b-9261-4a1e-b1f0-453127439d5a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "DELETE /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0/os-volume_attachments/4ad41d90-2cec-47d9-8e2f-c6bf2ee396d8" status: 202 len: 0 microversion: 2.1 time: 0.617974 Jan 10 11:39:00.062253 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 131/264] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jan 10 11:38:59 2022] DELETE /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0/os-volume_attachments/4ad41d90-2cec-47d9-8e2f-c6bf2ee396d8 => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:00.067547 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-60dc42f4-1193-4af3-8f2d-7248f3cdf5f6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:00.068356 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2ccc246a-d07a-401f-b200-504179741165 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:00.068816 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-60dc42f4-1193-4af3-8f2d-7248f3cdf5f6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:00.069343 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2ccc246a-d07a-401f-b200-504179741165 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:00.077555 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-60dc42f4-1193-4af3-8f2d-7248f3cdf5f6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:00.078020 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-60dc42f4-1193-4af3-8f2d-7248f3cdf5f6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:00.079222 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-60dc42f4-1193-4af3-8f2d-7248f3cdf5f6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:00.079867 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-60dc42f4-1193-4af3-8f2d-7248f3cdf5f6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:00.105959 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2ccc246a-d07a-401f-b200-504179741165 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:00.106786 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2ccc246a-d07a-401f-b200-504179741165 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:00.109369 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2ccc246a-d07a-401f-b200-504179741165 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:00.110133 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2ccc246a-d07a-401f-b200-504179741165 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:00.126637 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-60dc42f4-1193-4af3-8f2d-7248f3cdf5f6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064603 Jan 10 11:39:00.127599 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 132/265] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:39:00 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:39:00.205454 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b1720769-ce04-4c7f-afc4-2a7afea856f8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:00.206656 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b1720769-ce04-4c7f-afc4-2a7afea856f8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:00.215008 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b1720769-ce04-4c7f-afc4-2a7afea856f8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:00.216000 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b1720769-ce04-4c7f-afc4-2a7afea856f8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:00.217630 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b1720769-ce04-4c7f-afc4-2a7afea856f8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:00.218399 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b1720769-ce04-4c7f-afc4-2a7afea856f8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:00.362952 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b1720769-ce04-4c7f-afc4-2a7afea856f8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 27044 microversion: 2.20 time: 0.161131 Jan 10 11:39:00.368673 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 133/266] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:00 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 27044 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:00.374403 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ebe6b41a-7262-4853-b0b7-770acd13e5f0 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:00.375391 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ebe6b41a-7262-4853-b0b7-770acd13e5f0 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:00.383695 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ebe6b41a-7262-4853-b0b7-770acd13e5f0 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:00.384375 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ebe6b41a-7262-4853-b0b7-770acd13e5f0 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:00.385168 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ebe6b41a-7262-4853-b0b7-770acd13e5f0 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:00.385731 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ebe6b41a-7262-4853-b0b7-770acd13e5f0 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:00.388437 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2ccc246a-d07a-401f-b200-504179741165 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:00.422205 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2ccc246a-d07a-401f-b200-504179741165 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.356980 Jan 10 11:39:00.441335 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 134/267] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:00 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:00.451937 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-6539c64b-6294-4241-acf4-7abed05427fe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:00.453285 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-6539c64b-6294-4241-acf4-7abed05427fe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:00.464106 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6539c64b-6294-4241-acf4-7abed05427fe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:00.464931 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6539c64b-6294-4241-acf4-7abed05427fe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:00.465376 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ebe6b41a-7262-4853-b0b7-770acd13e5f0 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:00.466484 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6539c64b-6294-4241-acf4-7abed05427fe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:00.467263 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6539c64b-6294-4241-acf4-7abed05427fe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:00.473851 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ebe6b41a-7262-4853-b0b7-770acd13e5f0 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1267 microversion: 2.1 time: 0.103717 Jan 10 11:39:00.474472 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 134/268] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:00 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1267 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:00.600824 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-6539c64b-6294-4241-acf4-7abed05427fe tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 27588 microversion: 2.1 time: 0.157040 Jan 10 11:39:00.601690 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 135/269] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:00 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 27588 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:01.141597 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-cb487140-15b7-4714-93fb-13ef8de7054c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:01.145607 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-cb487140-15b7-4714-93fb-13ef8de7054c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:01.150709 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cb487140-15b7-4714-93fb-13ef8de7054c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:01.151461 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cb487140-15b7-4714-93fb-13ef8de7054c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:01.152486 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cb487140-15b7-4714-93fb-13ef8de7054c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:01.154524 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cb487140-15b7-4714-93fb-13ef8de7054c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:01.195637 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-cb487140-15b7-4714-93fb-13ef8de7054c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058075 Jan 10 11:39:01.196821 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 135/270] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:39:01 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:39:01.378451 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-6f5e446b-0118-4e8d-91dc-a7233a812760 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:01.379861 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-6f5e446b-0118-4e8d-91dc-a7233a812760 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:01.404272 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6f5e446b-0118-4e8d-91dc-a7233a812760 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:01.405439 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6f5e446b-0118-4e8d-91dc-a7233a812760 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:01.407250 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6f5e446b-0118-4e8d-91dc-a7233a812760 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:01.408546 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6f5e446b-0118-4e8d-91dc-a7233a812760 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:01.427778 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8b9e19a5-1568-4fd0-b9c4-e982d50d2c3f tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] Action: 'create', calling method: .version_select at 0x7f4779c09c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-564865100", "metadata": {"Type": "work"}}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:01.429881 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8b9e19a5-1568-4fd0-b9c4-e982d50d2c3f tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:39:01.436593 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-8b9e19a5-1568-4fd0-b9c4-e982d50d2c3f tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.185296 Jan 10 11:39:01.438664 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 136/271] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jan 10 11:39:01 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 10 11:39:01.465448 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ec8c7310-283b-4684-b69f-c7670efd8bae tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] Action: 'create', calling method: .version_select at 0x7f477a6a6af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-400733513", "metadata": {"Type": "work"}}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:01.467620 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ec8c7310-283b-4684-b69f-c7670efd8bae tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:39:01.475710 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ec8c7310-283b-4684-b69f-c7670efd8bae tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023173 Jan 10 11:39:01.475710 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 137/272] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jan 10 11:39:01 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 10 11:39:01.484283 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-284cf559-600a-4314-8bac-5d719f97abdd tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:01.488894 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-284cf559-600a-4314-8bac-5d719f97abdd tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:01.506086 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-284cf559-600a-4314-8bac-5d719f97abdd tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:01.511019 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-284cf559-600a-4314-8bac-5d719f97abdd tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:01.512493 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-284cf559-600a-4314-8bac-5d719f97abdd tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:01.513707 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-284cf559-600a-4314-8bac-5d719f97abdd tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:01.567260 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-6f5e446b-0118-4e8d-91dc-a7233a812760 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 27478 microversion: 2.20 time: 0.193696 Jan 10 11:39:01.568412 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 136/273] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:01 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 27478 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 11:39:01.579260 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5a4851f0-172a-49a3-b7af-f23201e7842c tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] Action: 'create', calling method: .version_select at 0x7f477a5e50d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2042399475", "metadata": {"Type": "work"}}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:01.581322 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5a4851f0-172a-49a3-b7af-f23201e7842c tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:39:01.582625 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5a4851f0-172a-49a3-b7af-f23201e7842c tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010866 Jan 10 11:39:01.584332 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 137/274] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Jan 10 11:39:01 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 10 11:39:01.596003 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-0c3b242f-0e7f-46a1-9564-b10eebe9b7d7 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:01.603812 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-0c3b242f-0e7f-46a1-9564-b10eebe9b7d7 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:01.609298 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0c3b242f-0e7f-46a1-9564-b10eebe9b7d7 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:01.610036 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0c3b242f-0e7f-46a1-9564-b10eebe9b7d7 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:01.611657 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0c3b242f-0e7f-46a1-9564-b10eebe9b7d7 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:01.612335 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0c3b242f-0e7f-46a1-9564-b10eebe9b7d7 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:01.719985 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-0c3b242f-0e7f-46a1-9564-b10eebe9b7d7 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:01.731468 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-0c3b242f-0e7f-46a1-9564-b10eebe9b7d7 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1285 microversion: 2.1 time: 0.142951 Jan 10 11:39:01.732068 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 138/275] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:01 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:01.746610 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-36ed2dd2-c108-4179-a571-552a7dc3cbf2 tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] Calling method '.version_select at 0x7f477a5e5160>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:01.809910 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-36ed2dd2-c108-4179-a571-552a7dc3cbf2 tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] HTTP exception thrown: Volume tempest-invalid-1489435489 could not be found. Jan 10 11:39:01.810927 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-36ed2dd2-c108-4179-a571-552a7dc3cbf2 tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] Returning 404 to user: Volume tempest-invalid-1489435489 could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:39:01.812010 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-36ed2dd2-c108-4179-a571-552a7dc3cbf2 tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1489435489" status: 404 len: 99 microversion: 2.1 time: 0.078760 Jan 10 11:39:01.812778 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 139/276] 10.222.0.20 () {58 vars in 1217 bytes} [Mon Jan 10 11:39:01 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1489435489 => generated 99 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 10 11:39:01.815448 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-284cf559-600a-4314-8bac-5d719f97abdd tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:01.818915 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-741f275e-790d-4c04-9f4d-3943a36380f8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:01.821021 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-741f275e-790d-4c04-9f4d-3943a36380f8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:01.837489 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-741f275e-790d-4c04-9f4d-3943a36380f8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:01.837980 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-741f275e-790d-4c04-9f4d-3943a36380f8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:01.838903 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-741f275e-790d-4c04-9f4d-3943a36380f8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:01.839352 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-741f275e-790d-4c04-9f4d-3943a36380f8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:01.845341 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-284cf559-600a-4314-8bac-5d719f97abdd tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.366640 Jan 10 11:39:01.846116 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 138/277] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:01 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:01.852754 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-bd828f53-3055-4d05-99ee-0cefbb651a9d tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004124 Jan 10 11:39:01.853771 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 139/278] 10.222.0.20 () {58 vars in 1139 bytes} [Mon Jan 10 11:39:01 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 10 11:39:01.869147 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2abe7ee1-02ce-4fde-b748-1b8f8f79866f tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004519 Jan 10 11:39:01.870196 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 140/279] 10.222.0.20 () {58 vars in 1136 bytes} [Mon Jan 10 11:39:01 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 10 11:39:01.881079 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2d30e89a-bb16-4527-9b06-6979a923e4b1 tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] Calling method '.version_select at 0x7f4779c04dc0>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:01.922582 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-2d30e89a-bb16-4527-9b06-6979a923e4b1 tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] HTTP exception thrown: Volume 3a2c7749-de0f-4735-ad34-da49692d4fb1 could not be found. Jan 10 11:39:01.923208 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2d30e89a-bb16-4527-9b06-6979a923e4b1 tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] Returning 404 to user: Volume 3a2c7749-de0f-4735-ad34-da49692d4fb1 could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:39:01.924033 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2d30e89a-bb16-4527-9b06-6979a923e4b1 tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/3a2c7749-de0f-4735-ad34-da49692d4fb1" status: 404 len: 109 microversion: 2.1 time: 0.048625 Jan 10 11:39:01.924748 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 141/280] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jan 10 11:39:01 2022] DELETE /compute/v2.1/os-volumes/3a2c7749-de0f-4735-ad34-da49692d4fb1 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 10 11:39:01.941690 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a01a8c73-e602-4088-934c-6511074d79be tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] Calling method '.version_select at 0x7f4779d44280>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:01.961269 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-741f275e-790d-4c04-9f4d-3943a36380f8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 27956 microversion: 2.1 time: 0.146011 Jan 10 11:39:01.962417 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 140/281] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:01 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 27956 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:01.979422 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-a01a8c73-e602-4088-934c-6511074d79be tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] HTTP exception thrown: Volume daf75d99-c797-4201-90c9-b9f924e33047 could not be found. Jan 10 11:39:01.980200 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a01a8c73-e602-4088-934c-6511074d79be tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] Returning 404 to user: Volume daf75d99-c797-4201-90c9-b9f924e33047 could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:39:01.981071 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a01a8c73-e602-4088-934c-6511074d79be tempest-VolumesNegativeTest-271737917 tempest-VolumesNegativeTest-271737917-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/daf75d99-c797-4201-90c9-b9f924e33047" status: 404 len: 109 microversion: 2.1 time: 0.046113 Jan 10 11:39:01.981912 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 142/282] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jan 10 11:39:01 2022] GET /compute/v2.1/os-volumes/daf75d99-c797-4201-90c9-b9f924e33047 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:39:02.211577 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-0034dd31-41e3-44bb-a5c8-76835cd9efbd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:02.212599 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-0034dd31-41e3-44bb-a5c8-76835cd9efbd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:02.219973 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0034dd31-41e3-44bb-a5c8-76835cd9efbd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:02.220340 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0034dd31-41e3-44bb-a5c8-76835cd9efbd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:02.221192 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0034dd31-41e3-44bb-a5c8-76835cd9efbd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:02.221637 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0034dd31-41e3-44bb-a5c8-76835cd9efbd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:02.255703 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-0034dd31-41e3-44bb-a5c8-76835cd9efbd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049296 Jan 10 11:39:02.256283 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 141/283] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:39:02 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:39:02.584018 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f0e3037b-dabc-41c5-8e43-f87095ad8492 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:02.584736 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f0e3037b-dabc-41c5-8e43-f87095ad8492 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:02.598241 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f0e3037b-dabc-41c5-8e43-f87095ad8492 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:02.598836 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f0e3037b-dabc-41c5-8e43-f87095ad8492 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:02.599505 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d6188243-357f-4dbd-9bbf-55e888cdfd2e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1273896705", "imageRef": "b6e63192-9c33-4d80-9555-6de2bb10fd32", "flavorRef": "452", "networks": [{"uuid": "73452465-d5d7-4c27-928c-80c648c05035"}]}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:02.603145 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f0e3037b-dabc-41c5-8e43-f87095ad8492 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:02.603716 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f0e3037b-dabc-41c5-8e43-f87095ad8492 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:02.688599 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.network.neutron [None req-d6188243-357f-4dbd-9bbf-55e888cdfd2e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] validate_networks() for [('73452465-d5d7-4c27-928c-80c648c05035', None, None, None, None, None)] {{(pid=128719) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:39:02.711090 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f0e3037b-dabc-41c5-8e43-f87095ad8492 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 27709 microversion: 2.20 time: 0.130192 Jan 10 11:39:02.714120 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 143/284] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:02 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 27709 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:02.765340 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a1f84dd7-d7f3-41ba-83c0-2bb787f53d6c tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:02.769415 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a1f84dd7-d7f3-41ba-83c0-2bb787f53d6c tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:02.809945 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a1f84dd7-d7f3-41ba-83c0-2bb787f53d6c tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:02.810581 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a1f84dd7-d7f3-41ba-83c0-2bb787f53d6c tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:02.811553 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a1f84dd7-d7f3-41ba-83c0-2bb787f53d6c tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:02.812118 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a1f84dd7-d7f3-41ba-83c0-2bb787f53d6c tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:03.246869 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-a1f84dd7-d7f3-41ba-83c0-2bb787f53d6c tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:03.259824 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a1f84dd7-d7f3-41ba-83c0-2bb787f53d6c tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1315 microversion: 2.1 time: 0.505808 Jan 10 11:39:03.261949 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 144/285] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:02 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:39:03.267432 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-9a9240bf-707e-4810-98e9-93baaba09242 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:03.268699 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-9a9240bf-707e-4810-98e9-93baaba09242 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:03.277572 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9a9240bf-707e-4810-98e9-93baaba09242 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:03.279558 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9a9240bf-707e-4810-98e9-93baaba09242 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:03.279558 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9a9240bf-707e-4810-98e9-93baaba09242 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:03.279903 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9a9240bf-707e-4810-98e9-93baaba09242 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:03.651389 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-9a9240bf-707e-4810-98e9-93baaba09242 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:03.658654 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-d6188243-357f-4dbd-9bbf-55e888cdfd2e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Flavor limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:39:03.659486 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-d6188243-357f-4dbd-9bbf-55e888cdfd2e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Image limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:39:03.659486 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-d6188243-357f-4dbd-9bbf-55e888cdfd2e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Flavor pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:39:03.661030 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-d6188243-357f-4dbd-9bbf-55e888cdfd2e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Image pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:39:03.661030 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-d6188243-357f-4dbd-9bbf-55e888cdfd2e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:39:03.667293 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-9a9240bf-707e-4810-98e9-93baaba09242 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.403192 Jan 10 11:39:03.682252 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d6188243-357f-4dbd-9bbf-55e888cdfd2e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:03.682252 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d6188243-357f-4dbd-9bbf-55e888cdfd2e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:03.682252 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d6188243-357f-4dbd-9bbf-55e888cdfd2e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:03.682252 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d6188243-357f-4dbd-9bbf-55e888cdfd2e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:03.685917 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 145/286] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:03 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:03.702432 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-d6188243-357f-4dbd-9bbf-55e888cdfd2e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Getting quotas for project 1c300abbfb3b48dab6c40f20c7eb9cd1. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:39:03.702795 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a74ca6ea-5a97-4e32-a414-760471b4b71c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:03.704802 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a74ca6ea-5a97-4e32-a414-760471b4b71c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:03.707367 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-d6188243-357f-4dbd-9bbf-55e888cdfd2e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Getting quotas for user b6431c85b6c74608aae42e0e856d1a6d and project 1c300abbfb3b48dab6c40f20c7eb9cd1. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:39:03.718380 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a74ca6ea-5a97-4e32-a414-760471b4b71c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:03.719527 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a74ca6ea-5a97-4e32-a414-760471b4b71c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:03.721201 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a74ca6ea-5a97-4e32-a414-760471b4b71c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:03.722238 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a74ca6ea-5a97-4e32-a414-760471b4b71c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:03.730593 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d6188243-357f-4dbd-9bbf-55e888cdfd2e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Going to run 1 instances... {{(pid=128719) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:39:03.733297 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d6188243-357f-4dbd-9bbf-55e888cdfd2e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e63192-9c33-4d80-9555-6de2bb10fd32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:39:03.841034 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a74ca6ea-5a97-4e32-a414-760471b4b71c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 28191 microversion: 2.1 time: 0.145144 Jan 10 11:39:03.842171 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 146/287] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:03 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 28191 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:03.852806 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4eef2248-0c1b-45f4-9449-edc0991de2cc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:03.854687 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4eef2248-0c1b-45f4-9449-edc0991de2cc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:03.863892 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4eef2248-0c1b-45f4-9449-edc0991de2cc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:03.864482 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4eef2248-0c1b-45f4-9449-edc0991de2cc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:03.865466 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4eef2248-0c1b-45f4-9449-edc0991de2cc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:03.866036 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4eef2248-0c1b-45f4-9449-edc0991de2cc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:03.891055 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d6188243-357f-4dbd-9bbf-55e888cdfd2e tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.298604 Jan 10 11:39:03.892499 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 142/288] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:39:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 11:39:03.904575 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-555964da-4a35-4915-94b0-4a1200b4d901 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:03.905330 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-555964da-4a35-4915-94b0-4a1200b4d901 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:03.969978 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-555964da-4a35-4915-94b0-4a1200b4d901 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:03.970998 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4eef2248-0c1b-45f4-9449-edc0991de2cc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 28002 microversion: 2.20 time: 0.126148 Jan 10 11:39:03.972981 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 147/289] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:03 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 28002 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:04.031455 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-555964da-4a35-4915-94b0-4a1200b4d901 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1218 microversion: 2.1 time: 0.129660 Jan 10 11:39:04.040860 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 143/290] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:03 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:39:04.284447 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-38d876a0-a643-4790-818b-e514b1d922c3 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:04.287148 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-38d876a0-a643-4790-818b-e514b1d922c3 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:04.307905 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-38d876a0-a643-4790-818b-e514b1d922c3 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:04.308946 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-38d876a0-a643-4790-818b-e514b1d922c3 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:04.311111 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-38d876a0-a643-4790-818b-e514b1d922c3 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:04.311976 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-38d876a0-a643-4790-818b-e514b1d922c3 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:04.517426 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-38d876a0-a643-4790-818b-e514b1d922c3 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:04.532528 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-38d876a0-a643-4790-818b-e514b1d922c3 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1315 microversion: 2.1 time: 0.255406 Jan 10 11:39:04.533489 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 148/291] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:04 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:04.615890 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-9431e363-0fee-4ea6-aff8-2acec4798065 req-d3919ab7-4d7c-4f25-b58b-1caf760fb1ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5b8fbd4-4073-4498-9498-b440d643398a", "tag": "8c90115a-1680-4748-a6c3-094a2793bb13"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:04.644353 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:39:04.644353 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:39:04.659043 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-9431e363-0fee-4ea6-aff8-2acec4798065 req-d3919ab7-4d7c-4f25-b58b-1caf760fb1ae service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:04.660106 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-9431e363-0fee-4ea6-aff8-2acec4798065 req-d3919ab7-4d7c-4f25-b58b-1caf760fb1ae service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:04.671773 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-9431e363-0fee-4ea6-aff8-2acec4798065 req-d3919ab7-4d7c-4f25-b58b-1caf760fb1ae service nova] Creating event network-changed:8c90115a-1680-4748-a6c3-094a2793bb13 for instance e5b8fbd4-4073-4498-9498-b440d643398a on hv-cinder-maste Jan 10 11:39:04.677538 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-9431e363-0fee-4ea6-aff8-2acec4798065 req-d3919ab7-4d7c-4f25-b58b-1caf760fb1ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068863 Jan 10 11:39:04.678319 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 144/292] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:39:04.705726 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-91e90346-c854-4e77-a8bf-3d62cfb85f63 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:04.707051 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-91e90346-c854-4e77-a8bf-3d62cfb85f63 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:04.721326 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-91e90346-c854-4e77-a8bf-3d62cfb85f63 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:04.723254 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-91e90346-c854-4e77-a8bf-3d62cfb85f63 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:04.728365 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-91e90346-c854-4e77-a8bf-3d62cfb85f63 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:04.729547 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-91e90346-c854-4e77-a8bf-3d62cfb85f63 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:04.864123 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5ce7fc5a-5ad5-4a81-9c2a-7d3c7ee68e0f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:04.871768 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5ce7fc5a-5ad5-4a81-9c2a-7d3c7ee68e0f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:04.925881 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5ce7fc5a-5ad5-4a81-9c2a-7d3c7ee68e0f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:04.927591 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5ce7fc5a-5ad5-4a81-9c2a-7d3c7ee68e0f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:04.932852 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5ce7fc5a-5ad5-4a81-9c2a-7d3c7ee68e0f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:04.933906 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5ce7fc5a-5ad5-4a81-9c2a-7d3c7ee68e0f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:05.060403 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-91e90346-c854-4e77-a8bf-3d62cfb85f63 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:05.078088 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5ce7fc5a-5ad5-4a81-9c2a-7d3c7ee68e0f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 28482 microversion: 2.1 time: 0.222494 Jan 10 11:39:05.079348 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 145/293] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:04 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 28482 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:39:05.086404 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a5b67ee2-a91f-4f22-ab21-ee5cfc35d28c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:05.088381 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-91e90346-c854-4e77-a8bf-3d62cfb85f63 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.390163 Jan 10 11:39:05.089164 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 149/294] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:04 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:05.093742 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a5b67ee2-a91f-4f22-ab21-ee5cfc35d28c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:05.108775 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-5a9e083e-a79e-4266-841d-a47dd5a608e0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:05.109902 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-5a9e083e-a79e-4266-841d-a47dd5a608e0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:05.118768 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a5b67ee2-a91f-4f22-ab21-ee5cfc35d28c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:05.119542 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a5b67ee2-a91f-4f22-ab21-ee5cfc35d28c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:05.120927 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a5b67ee2-a91f-4f22-ab21-ee5cfc35d28c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:05.121713 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a5b67ee2-a91f-4f22-ab21-ee5cfc35d28c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:05.255846 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-5a9e083e-a79e-4266-841d-a47dd5a608e0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:05.277952 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-5a9e083e-a79e-4266-841d-a47dd5a608e0 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1218 microversion: 2.1 time: 0.176296 Jan 10 11:39:05.277952 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 150/295] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:05 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:05.283928 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a5b67ee2-a91f-4f22-ab21-ee5cfc35d28c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 28189 microversion: 2.20 time: 0.202911 Jan 10 11:39:05.284817 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 146/296] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:05 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 28189 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:05.551067 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-187515cf-a06d-4910-b157-849b1adf6fa5 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:05.551757 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-187515cf-a06d-4910-b157-849b1adf6fa5 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:05.559788 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-187515cf-a06d-4910-b157-849b1adf6fa5 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:05.560592 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-187515cf-a06d-4910-b157-849b1adf6fa5 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:05.561628 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-187515cf-a06d-4910-b157-849b1adf6fa5 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:05.562339 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-187515cf-a06d-4910-b157-849b1adf6fa5 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:05.723970 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-187515cf-a06d-4910-b157-849b1adf6fa5 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:05.732829 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-187515cf-a06d-4910-b157-849b1adf6fa5 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1315 microversion: 2.1 time: 0.185198 Jan 10 11:39:05.733429 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 151/297] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:05 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:06.091219 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-6a143116-3091-4c8a-90a0-52cc12196df5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:06.092272 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-6a143116-3091-4c8a-90a0-52cc12196df5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:06.100466 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6a143116-3091-4c8a-90a0-52cc12196df5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:06.101423 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6a143116-3091-4c8a-90a0-52cc12196df5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:06.102304 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6a143116-3091-4c8a-90a0-52cc12196df5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:06.102749 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6a143116-3091-4c8a-90a0-52cc12196df5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:06.120293 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3b62fa6d-dcfa-4c34-8f0d-4ce4663c886c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:06.121036 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3b62fa6d-dcfa-4c34-8f0d-4ce4663c886c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:06.127868 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3b62fa6d-dcfa-4c34-8f0d-4ce4663c886c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:06.128326 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3b62fa6d-dcfa-4c34-8f0d-4ce4663c886c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:06.129127 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3b62fa6d-dcfa-4c34-8f0d-4ce4663c886c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:06.129570 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3b62fa6d-dcfa-4c34-8f0d-4ce4663c886c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:06.204229 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-6a143116-3091-4c8a-90a0-52cc12196df5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 28482 microversion: 2.1 time: 0.116354 Jan 10 11:39:06.210906 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 147/298] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:06 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 28482 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:39:06.300795 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-76b54bed-285e-432d-81ac-2e39c0e44ae7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:06.302026 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-76b54bed-285e-432d-81ac-2e39c0e44ae7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:06.314578 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-76b54bed-285e-432d-81ac-2e39c0e44ae7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:06.315294 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-76b54bed-285e-432d-81ac-2e39c0e44ae7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:06.316608 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-76b54bed-285e-432d-81ac-2e39c0e44ae7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:06.317736 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-76b54bed-285e-432d-81ac-2e39c0e44ae7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:06.327457 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3b62fa6d-dcfa-4c34-8f0d-4ce4663c886c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:06.336411 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3b62fa6d-dcfa-4c34-8f0d-4ce4663c886c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.221451 Jan 10 11:39:06.337123 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 152/299] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:06 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:06.349957 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-07af7928-f519-4335-8900-ed6da722293e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:06.351713 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-07af7928-f519-4335-8900-ed6da722293e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:06.358711 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-07af7928-f519-4335-8900-ed6da722293e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:06.359164 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-07af7928-f519-4335-8900-ed6da722293e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:06.359957 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-07af7928-f519-4335-8900-ed6da722293e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:06.360392 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-07af7928-f519-4335-8900-ed6da722293e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:06.417526 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-76b54bed-285e-432d-81ac-2e39c0e44ae7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:06.437943 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-76b54bed-285e-432d-81ac-2e39c0e44ae7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1222 microversion: 2.1 time: 0.144672 Jan 10 11:39:06.438570 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 148/300] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:06 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1222 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:06.508813 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-07af7928-f519-4335-8900-ed6da722293e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 28204 microversion: 2.20 time: 0.168003 Jan 10 11:39:06.519488 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 153/301] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:06 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 28204 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:06.753726 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-1b628cf3-bea9-4449-9c50-b2535e5190ab tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:06.754379 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-1b628cf3-bea9-4449-9c50-b2535e5190ab tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:06.762022 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1b628cf3-bea9-4449-9c50-b2535e5190ab tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:06.762498 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1b628cf3-bea9-4449-9c50-b2535e5190ab tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:06.763288 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1b628cf3-bea9-4449-9c50-b2535e5190ab tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:06.763718 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1b628cf3-bea9-4449-9c50-b2535e5190ab tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:06.981815 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-1b628cf3-bea9-4449-9c50-b2535e5190ab tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:06.990075 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-1b628cf3-bea9-4449-9c50-b2535e5190ab tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1315 microversion: 2.1 time: 0.243215 Jan 10 11:39:06.990780 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 149/302] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:06 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:07.220492 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f5cc9042-c202-459a-9eb8-a17b1927105f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:07.221732 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f5cc9042-c202-459a-9eb8-a17b1927105f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:07.233012 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f5cc9042-c202-459a-9eb8-a17b1927105f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:07.233737 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f5cc9042-c202-459a-9eb8-a17b1927105f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:07.234591 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f5cc9042-c202-459a-9eb8-a17b1927105f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:07.235028 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f5cc9042-c202-459a-9eb8-a17b1927105f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:07.340357 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f5cc9042-c202-459a-9eb8-a17b1927105f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 28649 microversion: 2.1 time: 0.125632 Jan 10 11:39:07.341042 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 154/303] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:07 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 28649 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:07.354292 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-14dd6e74-f6db-43d0-ae80-7124bb7a3e13 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:07.356019 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-14dd6e74-f6db-43d0-ae80-7124bb7a3e13 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:07.364193 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-14dd6e74-f6db-43d0-ae80-7124bb7a3e13 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:07.364550 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-14dd6e74-f6db-43d0-ae80-7124bb7a3e13 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:07.365382 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-14dd6e74-f6db-43d0-ae80-7124bb7a3e13 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:07.366175 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-14dd6e74-f6db-43d0-ae80-7124bb7a3e13 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:07.463037 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b1bad0d8-8dc4-4254-aabe-5cff14ed2293 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:07.464734 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b1bad0d8-8dc4-4254-aabe-5cff14ed2293 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:07.477490 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b1bad0d8-8dc4-4254-aabe-5cff14ed2293 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:07.478818 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b1bad0d8-8dc4-4254-aabe-5cff14ed2293 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:07.480604 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b1bad0d8-8dc4-4254-aabe-5cff14ed2293 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:07.481753 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b1bad0d8-8dc4-4254-aabe-5cff14ed2293 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:07.600129 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b1bad0d8-8dc4-4254-aabe-5cff14ed2293 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:07.604992 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-14dd6e74-f6db-43d0-ae80-7124bb7a3e13 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:07.609405 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b1bad0d8-8dc4-4254-aabe-5cff14ed2293 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1270 microversion: 2.1 time: 0.154709 Jan 10 11:39:07.611958 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 155/304] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:07 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:07.619771 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3478aee4-a487-4057-ba71-bca1dcfa7cb7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:07.622049 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3478aee4-a487-4057-ba71-bca1dcfa7cb7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:07.623853 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-14dd6e74-f6db-43d0-ae80-7124bb7a3e13 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.273847 Jan 10 11:39:07.624692 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 150/305] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:07 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:07.638580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3478aee4-a487-4057-ba71-bca1dcfa7cb7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:07.639110 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3478aee4-a487-4057-ba71-bca1dcfa7cb7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:07.640009 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3478aee4-a487-4057-ba71-bca1dcfa7cb7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:07.640499 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3478aee4-a487-4057-ba71-bca1dcfa7cb7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:07.744841 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3478aee4-a487-4057-ba71-bca1dcfa7cb7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 28476 microversion: 2.20 time: 0.130084 Jan 10 11:39:07.747133 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 156/306] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:07 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 28476 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:08.013610 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-4e55f801-5fca-4dfa-b332-c16a674d7f5a tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:08.013610 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-4e55f801-5fca-4dfa-b332-c16a674d7f5a tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:08.023573 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4e55f801-5fca-4dfa-b332-c16a674d7f5a tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:08.024540 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4e55f801-5fca-4dfa-b332-c16a674d7f5a tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:08.025494 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4e55f801-5fca-4dfa-b332-c16a674d7f5a tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:08.026250 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4e55f801-5fca-4dfa-b332-c16a674d7f5a tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:08.361274 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-adf9880b-941a-4d3b-bd7b-f78d10463479 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:08.363535 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-adf9880b-941a-4d3b-bd7b-f78d10463479 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:08.373241 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-adf9880b-941a-4d3b-bd7b-f78d10463479 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:08.373990 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-adf9880b-941a-4d3b-bd7b-f78d10463479 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:08.375354 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-adf9880b-941a-4d3b-bd7b-f78d10463479 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:08.376103 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-adf9880b-941a-4d3b-bd7b-f78d10463479 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:08.421915 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-4e55f801-5fca-4dfa-b332-c16a674d7f5a tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:08.442395 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-4e55f801-5fca-4dfa-b332-c16a674d7f5a tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1315 microversion: 2.1 time: 0.438716 Jan 10 11:39:08.452097 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 151/307] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:08 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:08.467054 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-adf9880b-941a-4d3b-bd7b-f78d10463479 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 28649 microversion: 2.1 time: 0.111641 Jan 10 11:39:08.467716 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 157/308] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:08 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 28649 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:08.635323 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-61971b79-970a-4be7-b30b-22d85f5a5000 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:08.636489 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-61971b79-970a-4be7-b30b-22d85f5a5000 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:08.645954 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-40310079-d3df-4f69-adc8-bce314512ded tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:08.646885 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-40310079-d3df-4f69-adc8-bce314512ded tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:08.655688 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-61971b79-970a-4be7-b30b-22d85f5a5000 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:08.656195 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-61971b79-970a-4be7-b30b-22d85f5a5000 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:08.657786 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-40310079-d3df-4f69-adc8-bce314512ded tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:08.658348 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-40310079-d3df-4f69-adc8-bce314512ded tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:08.659220 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-40310079-d3df-4f69-adc8-bce314512ded tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:08.659664 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-40310079-d3df-4f69-adc8-bce314512ded tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:08.660497 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-61971b79-970a-4be7-b30b-22d85f5a5000 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:08.661466 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-61971b79-970a-4be7-b30b-22d85f5a5000 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:09.000120 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-61971b79-970a-4be7-b30b-22d85f5a5000 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:09.016634 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-40310079-d3df-4f69-adc8-bce314512ded tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:09.034434 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-61971b79-970a-4be7-b30b-22d85f5a5000 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1318 microversion: 2.1 time: 0.406239 Jan 10 11:39:09.048652 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-40310079-d3df-4f69-adc8-bce314512ded tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.395782 Jan 10 11:39:09.060378 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 158/309] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:08 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:39:09.060667 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 152/310] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:08 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:09.065018 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-be918799-2997-4c77-aa89-60531a94e764 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:09.068301 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-be918799-2997-4c77-aa89-60531a94e764 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:09.082750 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-be918799-2997-4c77-aa89-60531a94e764 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:09.083736 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-be918799-2997-4c77-aa89-60531a94e764 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:09.088029 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-be918799-2997-4c77-aa89-60531a94e764 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:09.088890 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-be918799-2997-4c77-aa89-60531a94e764 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:09.200459 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-be918799-2997-4c77-aa89-60531a94e764 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 28643 microversion: 2.20 time: 0.149537 Jan 10 11:39:09.201874 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 159/311] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:09 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 28643 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:09.465590 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7901bd48-bffb-41a7-9910-840263c4dd94 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:09.466978 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7901bd48-bffb-41a7-9910-840263c4dd94 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:09.475843 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7901bd48-bffb-41a7-9910-840263c4dd94 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:09.478154 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7901bd48-bffb-41a7-9910-840263c4dd94 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:09.484682 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7901bd48-bffb-41a7-9910-840263c4dd94 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:09.484682 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7901bd48-bffb-41a7-9910-840263c4dd94 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:09.485807 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-83fb015a-183d-4c51-b6e7-196f39b45dc5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:09.485807 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-83fb015a-183d-4c51-b6e7-196f39b45dc5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:09.496556 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-83fb015a-183d-4c51-b6e7-196f39b45dc5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:09.497122 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-83fb015a-183d-4c51-b6e7-196f39b45dc5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:09.498126 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-83fb015a-183d-4c51-b6e7-196f39b45dc5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:09.498671 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-83fb015a-183d-4c51-b6e7-196f39b45dc5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:09.591999 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-83fb015a-183d-4c51-b6e7-196f39b45dc5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 28649 microversion: 2.1 time: 0.115733 Jan 10 11:39:09.595691 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 160/312] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:09 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 28649 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:39:09.762889 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-7901bd48-bffb-41a7-9910-840263c4dd94 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:09.772181 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7901bd48-bffb-41a7-9910-840263c4dd94 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1315 microversion: 2.1 time: 0.311703 Jan 10 11:39:09.774107 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 153/313] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:09 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:10.064208 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-6595213c-4b3b-468a-971c-72ab8f9c3daf tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:10.065658 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-6595213c-4b3b-468a-971c-72ab8f9c3daf tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:10.075871 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-16433c9d-7394-4bb2-8fa6-2df205046797 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:10.076571 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-16433c9d-7394-4bb2-8fa6-2df205046797 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:10.093080 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6595213c-4b3b-468a-971c-72ab8f9c3daf tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:10.094023 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6595213c-4b3b-468a-971c-72ab8f9c3daf tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:10.095441 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6595213c-4b3b-468a-971c-72ab8f9c3daf tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:10.096229 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6595213c-4b3b-468a-971c-72ab8f9c3daf tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:10.098744 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-16433c9d-7394-4bb2-8fa6-2df205046797 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:10.099367 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-16433c9d-7394-4bb2-8fa6-2df205046797 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:10.100353 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-16433c9d-7394-4bb2-8fa6-2df205046797 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:10.100800 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-16433c9d-7394-4bb2-8fa6-2df205046797 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:10.423961 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-6595213c-4b3b-468a-971c-72ab8f9c3daf tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:10.439625 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-16433c9d-7394-4bb2-8fa6-2df205046797 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:10.449965 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-16433c9d-7394-4bb2-8fa6-2df205046797 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.377678 Jan 10 11:39:10.452330 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 154/314] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:10 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:10.455440 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-6595213c-4b3b-468a-971c-72ab8f9c3daf tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1318 microversion: 2.1 time: 0.397755 Jan 10 11:39:10.457190 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 161/315] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:10 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:10.459804 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-e6feddbc-6128-4f41-891a-41335c5b2a30 req-1aeffd57-a49d-478f-a8a0-06d0975cdc17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff525c9-af1a-4b34-9c03-56f07ebd1d96", "tag": "521ffce9-574e-43ff-9566-482167228f8f"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:10.462558 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:39:10.462558 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:39:10.471118 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c5368ec5-f351-4d1d-bec5-71331ebc9a3f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:10.472713 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c5368ec5-f351-4d1d-bec5-71331ebc9a3f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:10.474755 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-e6feddbc-6128-4f41-891a-41335c5b2a30 req-1aeffd57-a49d-478f-a8a0-06d0975cdc17 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:10.476837 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-e6feddbc-6128-4f41-891a-41335c5b2a30 req-1aeffd57-a49d-478f-a8a0-06d0975cdc17 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:10.481617 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c5368ec5-f351-4d1d-bec5-71331ebc9a3f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:10.482390 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c5368ec5-f351-4d1d-bec5-71331ebc9a3f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:10.483667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c5368ec5-f351-4d1d-bec5-71331ebc9a3f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:10.484259 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c5368ec5-f351-4d1d-bec5-71331ebc9a3f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:10.498370 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-e6feddbc-6128-4f41-891a-41335c5b2a30 req-1aeffd57-a49d-478f-a8a0-06d0975cdc17 service nova] Creating event network-changed:521ffce9-574e-43ff-9566-482167228f8f for instance 9ff525c9-af1a-4b34-9c03-56f07ebd1d96 on hv-cinder-maste Jan 10 11:39:10.510302 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-e6feddbc-6128-4f41-891a-41335c5b2a30 req-1aeffd57-a49d-478f-a8a0-06d0975cdc17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054539 Jan 10 11:39:10.512073 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 155/316] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:39:10.561091 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c5368ec5-f351-4d1d-bec5-71331ebc9a3f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 28643 microversion: 2.20 time: 0.100846 Jan 10 11:39:10.561879 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 162/317] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:10 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 28643 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:10.607082 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9ae308a7-ec6b-4fff-bc2a-e74461edd903 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:10.608373 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9ae308a7-ec6b-4fff-bc2a-e74461edd903 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:10.616895 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9ae308a7-ec6b-4fff-bc2a-e74461edd903 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:10.617761 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9ae308a7-ec6b-4fff-bc2a-e74461edd903 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:10.618822 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9ae308a7-ec6b-4fff-bc2a-e74461edd903 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:10.619446 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9ae308a7-ec6b-4fff-bc2a-e74461edd903 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:10.703771 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9ae308a7-ec6b-4fff-bc2a-e74461edd903 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 28649 microversion: 2.1 time: 0.097344 Jan 10 11:39:10.703771 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 156/318] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:10 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 28649 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:39:10.792271 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-22d7986c-067b-477b-9a09-630f82bc6b15 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:10.793327 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-22d7986c-067b-477b-9a09-630f82bc6b15 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:10.800984 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-22d7986c-067b-477b-9a09-630f82bc6b15 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:10.801432 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-22d7986c-067b-477b-9a09-630f82bc6b15 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:10.802238 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-22d7986c-067b-477b-9a09-630f82bc6b15 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:10.802684 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-22d7986c-067b-477b-9a09-630f82bc6b15 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:10.953055 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-22d7986c-067b-477b-9a09-630f82bc6b15 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:10.961205 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-22d7986c-067b-477b-9a09-630f82bc6b15 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1315 microversion: 2.1 time: 0.174860 Jan 10 11:39:10.961889 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 163/319] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:10 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:11.480681 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-87c199d4-4c48-4b52-a9fa-7a623c143a92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:11.481796 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-87c199d4-4c48-4b52-a9fa-7a623c143a92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:11.489796 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f619c2b8-666c-4b2b-bc8d-93a43a4ea524 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:11.494267 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f619c2b8-666c-4b2b-bc8d-93a43a4ea524 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:11.508693 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-87c199d4-4c48-4b52-a9fa-7a623c143a92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:11.508693 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-87c199d4-4c48-4b52-a9fa-7a623c143a92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:11.508693 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-87c199d4-4c48-4b52-a9fa-7a623c143a92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:11.508693 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-87c199d4-4c48-4b52-a9fa-7a623c143a92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:11.519803 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f619c2b8-666c-4b2b-bc8d-93a43a4ea524 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:11.520508 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f619c2b8-666c-4b2b-bc8d-93a43a4ea524 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:11.521596 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f619c2b8-666c-4b2b-bc8d-93a43a4ea524 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:11.521743 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f619c2b8-666c-4b2b-bc8d-93a43a4ea524 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:11.791891 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-f619c2b8-666c-4b2b-bc8d-93a43a4ea524 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:11.803528 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f619c2b8-666c-4b2b-bc8d-93a43a4ea524 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1318 microversion: 2.1 time: 0.329512 Jan 10 11:39:11.806918 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 157/320] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:11 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:11.814462 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-00971fd7-2101-4d07-9c06-1b701a9b4115 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:11.815605 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-00971fd7-2101-4d07-9c06-1b701a9b4115 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:11.822832 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-00971fd7-2101-4d07-9c06-1b701a9b4115 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:11.823677 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-00971fd7-2101-4d07-9c06-1b701a9b4115 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:11.824727 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-00971fd7-2101-4d07-9c06-1b701a9b4115 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:11.825230 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-00971fd7-2101-4d07-9c06-1b701a9b4115 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:11.827566 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-87c199d4-4c48-4b52-a9fa-7a623c143a92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:11.837594 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-87c199d4-4c48-4b52-a9fa-7a623c143a92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.363929 Jan 10 11:39:11.838353 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 164/321] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:11 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:11.843326 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8cffc8be-919e-4acc-801a-60af637f7204 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:11.844364 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-8cffc8be-919e-4acc-801a-60af637f7204 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:11.853007 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8cffc8be-919e-4acc-801a-60af637f7204 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:11.858399 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8cffc8be-919e-4acc-801a-60af637f7204 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:11.858399 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8cffc8be-919e-4acc-801a-60af637f7204 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:11.858399 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8cffc8be-919e-4acc-801a-60af637f7204 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:11.907536 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-00971fd7-2101-4d07-9c06-1b701a9b4115 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 28643 microversion: 2.20 time: 0.101099 Jan 10 11:39:11.911516 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 158/322] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:11 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 28643 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:11.956804 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-8cffc8be-919e-4acc-801a-60af637f7204 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 28847 microversion: 2.1 time: 0.116966 Jan 10 11:39:11.957712 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 165/323] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:11 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 28847 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:11.986534 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-fbc300dc-1cec-4508-8706-95122075adba tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:11.987242 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-fbc300dc-1cec-4508-8706-95122075adba tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:11.996646 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fbc300dc-1cec-4508-8706-95122075adba tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:12.005498 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fbc300dc-1cec-4508-8706-95122075adba tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:12.005498 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fbc300dc-1cec-4508-8706-95122075adba tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:12.005498 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fbc300dc-1cec-4508-8706-95122075adba tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:12.182128 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-fbc300dc-1cec-4508-8706-95122075adba tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:12.189511 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-fbc300dc-1cec-4508-8706-95122075adba tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1315 microversion: 2.1 time: 0.210020 Jan 10 11:39:12.197987 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 159/324] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:11 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:12.829961 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e4fdf106-8fe7-4f8e-bdc2-843bc2febbb2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:12.830736 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e4fdf106-8fe7-4f8e-bdc2-843bc2febbb2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:12.838417 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e4fdf106-8fe7-4f8e-bdc2-843bc2febbb2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:12.838877 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e4fdf106-8fe7-4f8e-bdc2-843bc2febbb2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:12.839721 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e4fdf106-8fe7-4f8e-bdc2-843bc2febbb2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:12.840122 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e4fdf106-8fe7-4f8e-bdc2-843bc2febbb2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:12.855443 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d0ac235d-647f-41fc-8877-689b2f64dcb2 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:12.858921 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d0ac235d-647f-41fc-8877-689b2f64dcb2 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:12.866004 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d0ac235d-647f-41fc-8877-689b2f64dcb2 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:12.867614 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d0ac235d-647f-41fc-8877-689b2f64dcb2 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:12.869265 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d0ac235d-647f-41fc-8877-689b2f64dcb2 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:12.870020 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d0ac235d-647f-41fc-8877-689b2f64dcb2 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:13.097807 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-d0ac235d-647f-41fc-8877-689b2f64dcb2 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:13.111176 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d0ac235d-647f-41fc-8877-689b2f64dcb2 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.255338 Jan 10 11:39:13.112359 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 160/325] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:12 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:39:13.115413 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-e4fdf106-8fe7-4f8e-bdc2-843bc2febbb2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:13.118921 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5680b5b2-3085-4dcb-8581-36de0872288e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:13.120132 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5680b5b2-3085-4dcb-8581-36de0872288e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:13.127433 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5680b5b2-3085-4dcb-8581-36de0872288e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:13.128089 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5680b5b2-3085-4dcb-8581-36de0872288e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:13.129030 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5680b5b2-3085-4dcb-8581-36de0872288e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:13.129611 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5680b5b2-3085-4dcb-8581-36de0872288e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:13.131142 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e4fdf106-8fe7-4f8e-bdc2-843bc2febbb2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1318 microversion: 2.1 time: 0.304653 Jan 10 11:39:13.133680 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 166/326] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:12 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:13.143799 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-01ddbc66-80d2-4d77-8313-a156b6ceee59 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:13.147289 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-01ddbc66-80d2-4d77-8313-a156b6ceee59 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:13.162283 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-01ddbc66-80d2-4d77-8313-a156b6ceee59 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:13.164759 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-01ddbc66-80d2-4d77-8313-a156b6ceee59 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:13.167062 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-01ddbc66-80d2-4d77-8313-a156b6ceee59 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:13.169322 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-01ddbc66-80d2-4d77-8313-a156b6ceee59 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:13.235979 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5680b5b2-3085-4dcb-8581-36de0872288e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 28643 microversion: 2.20 time: 0.114327 Jan 10 11:39:13.237384 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 161/327] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:13 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 28643 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:13.244091 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-0e38264b-dd1a-429c-81d8-bddef2d62312 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:13.245093 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-0e38264b-dd1a-429c-81d8-bddef2d62312 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:13.253465 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0e38264b-dd1a-429c-81d8-bddef2d62312 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:13.254026 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0e38264b-dd1a-429c-81d8-bddef2d62312 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:13.254970 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0e38264b-dd1a-429c-81d8-bddef2d62312 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:13.255621 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0e38264b-dd1a-429c-81d8-bddef2d62312 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:13.275725 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-01ddbc66-80d2-4d77-8313-a156b6ceee59 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 30249 microversion: 2.1 time: 0.139785 Jan 10 11:39:13.280442 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 167/328] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:13 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 30249 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:13.352665 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-4331166d-efa1-43d6-9adf-834ca13385a5 req-43d7a3ab-fb95-493c-9759-92e571da3b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b8fbd4-4073-4498-9498-b440d643398a", "name": "network-vif-plugged", "status": "completed", "tag": "8c90115a-1680-4748-a6c3-094a2793bb13"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:13.360289 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:39:13.360289 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:39:13.374423 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-4331166d-efa1-43d6-9adf-834ca13385a5 req-43d7a3ab-fb95-493c-9759-92e571da3b83 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:13.375280 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-4331166d-efa1-43d6-9adf-834ca13385a5 req-43d7a3ab-fb95-493c-9759-92e571da3b83 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:13.402855 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-4331166d-efa1-43d6-9adf-834ca13385a5 req-43d7a3ab-fb95-493c-9759-92e571da3b83 service nova] Creating event network-vif-plugged:8c90115a-1680-4748-a6c3-094a2793bb13 for instance e5b8fbd4-4073-4498-9498-b440d643398a on hv-cinder-maste Jan 10 11:39:13.410874 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-4331166d-efa1-43d6-9adf-834ca13385a5 req-43d7a3ab-fb95-493c-9759-92e571da3b83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066436 Jan 10 11:39:13.412232 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 168/329] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:39:13.462477 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-0e38264b-dd1a-429c-81d8-bddef2d62312 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:13.478187 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-0e38264b-dd1a-429c-81d8-bddef2d62312 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1315 microversion: 2.1 time: 0.239438 Jan 10 11:39:13.479767 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 162/330] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:13 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:14.139133 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2466f2d2-d5af-4f31-8f79-98410cc8ee05 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:14.141396 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2466f2d2-d5af-4f31-8f79-98410cc8ee05 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:14.148784 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2466f2d2-d5af-4f31-8f79-98410cc8ee05 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:14.149185 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2466f2d2-d5af-4f31-8f79-98410cc8ee05 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:14.149403 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f2e09869-db47-4993-8599-5a516f5467a3 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:14.153600 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2466f2d2-d5af-4f31-8f79-98410cc8ee05 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:14.153600 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2466f2d2-d5af-4f31-8f79-98410cc8ee05 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:14.153848 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f2e09869-db47-4993-8599-5a516f5467a3 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:14.164343 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f2e09869-db47-4993-8599-5a516f5467a3 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:14.165218 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f2e09869-db47-4993-8599-5a516f5467a3 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:14.166479 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f2e09869-db47-4993-8599-5a516f5467a3 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:14.168335 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f2e09869-db47-4993-8599-5a516f5467a3 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:14.432019 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2466f2d2-d5af-4f31-8f79-98410cc8ee05 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:14.441859 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2466f2d2-d5af-4f31-8f79-98410cc8ee05 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1502 microversion: 2.1 time: 0.313568 Jan 10 11:39:14.442986 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 169/331] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:14 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1502 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:14.448975 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c09a7683-de98-4e72-9fe9-69590a084749 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:14.451030 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c09a7683-de98-4e72-9fe9-69590a084749 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:14.459341 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c09a7683-de98-4e72-9fe9-69590a084749 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:14.461196 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c09a7683-de98-4e72-9fe9-69590a084749 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:14.462808 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c09a7683-de98-4e72-9fe9-69590a084749 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:14.463669 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c09a7683-de98-4e72-9fe9-69590a084749 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:14.463856 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-f2e09869-db47-4993-8599-5a516f5467a3 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:14.488076 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f2e09869-db47-4993-8599-5a516f5467a3 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1318 microversion: 2.1 time: 0.343037 Jan 10 11:39:14.488870 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 163/332] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:14 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:39:14.498010 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-dd89750f-295d-49d3-a0e6-f15418ec1da3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:14.499002 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-dd89750f-295d-49d3-a0e6-f15418ec1da3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:14.515553 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-dd89750f-295d-49d3-a0e6-f15418ec1da3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:14.516089 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-dd89750f-295d-49d3-a0e6-f15418ec1da3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:14.517980 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-dd89750f-295d-49d3-a0e6-f15418ec1da3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:14.524524 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-dd89750f-295d-49d3-a0e6-f15418ec1da3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:14.591500 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c09a7683-de98-4e72-9fe9-69590a084749 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 28794 microversion: 2.20 time: 0.146984 Jan 10 11:39:14.592084 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 170/333] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:14 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 28794 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:14.597338 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-695c177f-9ea7-46e2-87c8-de9d405661e8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23d9bee9-81d2-43b7-9d27-b1387dad634a"}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:14.598519 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-695c177f-9ea7-46e2-87c8-de9d405661e8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:14.605837 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-695c177f-9ea7-46e2-87c8-de9d405661e8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:14.606319 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-695c177f-9ea7-46e2-87c8-de9d405661e8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:14.607119 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-695c177f-9ea7-46e2-87c8-de9d405661e8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:14.607562 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-695c177f-9ea7-46e2-87c8-de9d405661e8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:14.633590 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-695c177f-9ea7-46e2-87c8-de9d405661e8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] HTTP exception thrown: Cannot 'attach_volume' instance 9bb75a87-2b05-43d3-b570-a04858874b50 while it is in vm_state rescued Jan 10 11:39:14.634133 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-695c177f-9ea7-46e2-87c8-de9d405661e8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Returning 409 to user: Cannot 'attach_volume' instance 9bb75a87-2b05-43d3-b570-a04858874b50 while it is in vm_state rescued {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:39:14.645092 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-695c177f-9ea7-46e2-87c8-de9d405661e8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "POST /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041846 Jan 10 11:39:14.645092 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 171/334] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jan 10 11:39:14 2022] POST /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 10 11:39:14.645092 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c892e915-7073-487a-b6d7-796bd918d380 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:14.645092 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c892e915-7073-487a-b6d7-796bd918d380 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:14.647643 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c892e915-7073-487a-b6d7-796bd918d380 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:14.648871 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c892e915-7073-487a-b6d7-796bd918d380 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:14.649887 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c892e915-7073-487a-b6d7-796bd918d380 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:14.650354 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c892e915-7073-487a-b6d7-796bd918d380 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:14.668856 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-dd89750f-295d-49d3-a0e6-f15418ec1da3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 31399 microversion: 2.1 time: 0.178579 Jan 10 11:39:14.669790 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 164/335] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:14 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 31399 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:14.675546 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d0290811-3a95-4cc6-9fa0-a1a93518377a tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:14.686903 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d0290811-3a95-4cc6-9fa0-a1a93518377a tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:14.696842 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d0290811-3a95-4cc6-9fa0-a1a93518377a tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:14.697580 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d0290811-3a95-4cc6-9fa0-a1a93518377a tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:14.698616 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d0290811-3a95-4cc6-9fa0-a1a93518377a tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:14.699275 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d0290811-3a95-4cc6-9fa0-a1a93518377a tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:14.854844 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c892e915-7073-487a-b6d7-796bd918d380 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:14.869856 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c892e915-7073-487a-b6d7-796bd918d380 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1315 microversion: 2.1 time: 0.233236 Jan 10 11:39:14.870568 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 172/336] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:14 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:15.065823 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d0290811-3a95-4cc6-9fa0-a1a93518377a tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "POST /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/action" status: 202 len: 0 microversion: 2.1 time: 0.394074 Jan 10 11:39:15.067220 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 165/337] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:14 2022] POST /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:15.077548 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7822b152-f81a-4607-a26d-7a051223867f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:15.078397 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7822b152-f81a-4607-a26d-7a051223867f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:15.091028 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7822b152-f81a-4607-a26d-7a051223867f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:15.091498 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7822b152-f81a-4607-a26d-7a051223867f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:15.092314 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7822b152-f81a-4607-a26d-7a051223867f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:15.097903 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7822b152-f81a-4607-a26d-7a051223867f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:15.273763 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7822b152-f81a-4607-a26d-7a051223867f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:15.281211 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7822b152-f81a-4607-a26d-7a051223867f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1510 microversion: 2.1 time: 0.207298 Jan 10 11:39:15.281808 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 173/338] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:15 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1510 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:15.510790 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7562dff9-bff9-4d76-be4f-d5099dd75818 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:15.511487 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7562dff9-bff9-4d76-be4f-d5099dd75818 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:15.518386 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7562dff9-bff9-4d76-be4f-d5099dd75818 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:15.518844 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7562dff9-bff9-4d76-be4f-d5099dd75818 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:15.519640 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7562dff9-bff9-4d76-be4f-d5099dd75818 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:15.520081 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7562dff9-bff9-4d76-be4f-d5099dd75818 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:15.604594 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-13f66502-0cc4-4a50-971d-85509076fd8c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:15.616196 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-13f66502-0cc4-4a50-971d-85509076fd8c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:15.630374 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-13f66502-0cc4-4a50-971d-85509076fd8c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:15.634037 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-13f66502-0cc4-4a50-971d-85509076fd8c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:15.635035 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-13f66502-0cc4-4a50-971d-85509076fd8c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:15.636211 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-13f66502-0cc4-4a50-971d-85509076fd8c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:15.708376 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-7562dff9-bff9-4d76-be4f-d5099dd75818 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:15.723585 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7562dff9-bff9-4d76-be4f-d5099dd75818 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1318 microversion: 2.1 time: 0.217249 Jan 10 11:39:15.741839 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 166/339] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:15 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:15.753127 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5fa4008f-3aab-4f94-842c-e78db46973d4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:15.755063 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5fa4008f-3aab-4f94-842c-e78db46973d4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:15.765967 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5fa4008f-3aab-4f94-842c-e78db46973d4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:15.767102 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5fa4008f-3aab-4f94-842c-e78db46973d4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:15.770066 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5fa4008f-3aab-4f94-842c-e78db46973d4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:15.771182 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5fa4008f-3aab-4f94-842c-e78db46973d4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:15.780135 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-13f66502-0cc4-4a50-971d-85509076fd8c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 29773 microversion: 2.20 time: 0.179329 Jan 10 11:39:15.781181 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 174/340] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:15 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 29773 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:15.889201 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4476fc02-972b-480b-b347-9d5361f7ef5d tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:15.890396 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4476fc02-972b-480b-b347-9d5361f7ef5d tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:15.891385 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5fa4008f-3aab-4f94-842c-e78db46973d4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 32071 microversion: 2.1 time: 0.147003 Jan 10 11:39:15.892987 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 167/341] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:15 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 32071 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:15.900082 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4476fc02-972b-480b-b347-9d5361f7ef5d tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:15.900985 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4476fc02-972b-480b-b347-9d5361f7ef5d tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:15.901885 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4476fc02-972b-480b-b347-9d5361f7ef5d tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:15.902560 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4476fc02-972b-480b-b347-9d5361f7ef5d tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:16.115327 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4476fc02-972b-480b-b347-9d5361f7ef5d tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:16.124580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4476fc02-972b-480b-b347-9d5361f7ef5d tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1315 microversion: 2.1 time: 0.242249 Jan 10 11:39:16.134368 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 175/342] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:15 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:39:16.300355 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-dd6f377d-0788-4fa2-8ee3-56a46b850e0b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:16.300984 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-dd6f377d-0788-4fa2-8ee3-56a46b850e0b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:16.308449 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-dd6f377d-0788-4fa2-8ee3-56a46b850e0b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:16.308898 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-dd6f377d-0788-4fa2-8ee3-56a46b850e0b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:16.309700 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-dd6f377d-0788-4fa2-8ee3-56a46b850e0b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:16.310135 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-dd6f377d-0788-4fa2-8ee3-56a46b850e0b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:16.540632 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-dd6f377d-0788-4fa2-8ee3-56a46b850e0b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:16.556212 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-dd6f377d-0788-4fa2-8ee3-56a46b850e0b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1510 microversion: 2.1 time: 0.259605 Jan 10 11:39:16.557271 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 168/343] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:16 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1510 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:16.762083 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8d9190c3-109c-4d9c-9f69-162478ec25c6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:16.762727 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-8d9190c3-109c-4d9c-9f69-162478ec25c6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:16.769471 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8d9190c3-109c-4d9c-9f69-162478ec25c6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:16.769915 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8d9190c3-109c-4d9c-9f69-162478ec25c6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:16.770761 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8d9190c3-109c-4d9c-9f69-162478ec25c6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:16.771196 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8d9190c3-109c-4d9c-9f69-162478ec25c6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:16.802858 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-88650ce9-aadd-4f8d-bcc7-c446e833d17e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:16.804472 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-88650ce9-aadd-4f8d-bcc7-c446e833d17e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:16.812192 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-88650ce9-aadd-4f8d-bcc7-c446e833d17e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:16.812818 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-88650ce9-aadd-4f8d-bcc7-c446e833d17e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:16.813729 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-88650ce9-aadd-4f8d-bcc7-c446e833d17e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:16.814138 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-88650ce9-aadd-4f8d-bcc7-c446e833d17e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:16.918387 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-88650ce9-aadd-4f8d-bcc7-c446e833d17e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 30754 microversion: 2.20 time: 0.129383 Jan 10 11:39:16.919041 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 169/344] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:16 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 30754 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 11:39:16.936861 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-6c64b914-f4c6-41c7-8a9d-9138a6651599 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:16.940158 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-6c64b914-f4c6-41c7-8a9d-9138a6651599 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:16.954708 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6c64b914-f4c6-41c7-8a9d-9138a6651599 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:16.954708 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6c64b914-f4c6-41c7-8a9d-9138a6651599 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:16.955512 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6c64b914-f4c6-41c7-8a9d-9138a6651599 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:16.963151 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6c64b914-f4c6-41c7-8a9d-9138a6651599 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:17.047092 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-8d9190c3-109c-4d9c-9f69-162478ec25c6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:17.057278 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-8d9190c3-109c-4d9c-9f69-162478ec25c6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1318 microversion: 2.1 time: 0.299878 Jan 10 11:39:17.064728 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 176/345] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:16 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:39:17.072112 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-6c64b914-f4c6-41c7-8a9d-9138a6651599 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 32588 microversion: 2.1 time: 0.151530 Jan 10 11:39:17.072955 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 170/346] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:16 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 32588 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:17.144578 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e714add2-9ece-42be-aad3-1623db0b6375 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:17.145731 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e714add2-9ece-42be-aad3-1623db0b6375 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:17.153856 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e714add2-9ece-42be-aad3-1623db0b6375 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:17.154388 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e714add2-9ece-42be-aad3-1623db0b6375 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:17.155181 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e714add2-9ece-42be-aad3-1623db0b6375 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:17.155619 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e714add2-9ece-42be-aad3-1623db0b6375 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:17.392720 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-d0eaa90b-c666-4584-b5e2-cead639d25fb req-6f04dcf7-5f46-4a4b-815e-572929037cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff525c9-af1a-4b34-9c03-56f07ebd1d96", "name": "network-vif-plugged", "status": "completed", "tag": "521ffce9-574e-43ff-9566-482167228f8f"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:17.394594 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:39:17.394594 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:39:17.403176 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-d0eaa90b-c666-4584-b5e2-cead639d25fb req-6f04dcf7-5f46-4a4b-815e-572929037cf1 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:17.404000 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-d0eaa90b-c666-4584-b5e2-cead639d25fb req-6f04dcf7-5f46-4a4b-815e-572929037cf1 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:17.418973 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-d0eaa90b-c666-4584-b5e2-cead639d25fb req-6f04dcf7-5f46-4a4b-815e-572929037cf1 service nova] Creating event network-vif-plugged:521ffce9-574e-43ff-9566-482167228f8f for instance 9ff525c9-af1a-4b34-9c03-56f07ebd1d96 on hv-cinder-maste Jan 10 11:39:17.427717 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-d0eaa90b-c666-4584-b5e2-cead639d25fb req-6f04dcf7-5f46-4a4b-815e-572929037cf1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037831 Jan 10 11:39:17.427717 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 171/347] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:39:17.443174 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-e714add2-9ece-42be-aad3-1623db0b6375 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:17.479266 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e714add2-9ece-42be-aad3-1623db0b6375 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1465 microversion: 2.1 time: 0.340805 Jan 10 11:39:17.480306 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 177/348] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:17 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1465 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:17.549726 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a5c7e221-cd75-41d5-a431-2e1b0f2adfa2 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:17.550444 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a5c7e221-cd75-41d5-a431-2e1b0f2adfa2 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:17.570748 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a5c7e221-cd75-41d5-a431-2e1b0f2adfa2 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:17.571324 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a5c7e221-cd75-41d5-a431-2e1b0f2adfa2 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:17.573927 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a5c7e221-cd75-41d5-a431-2e1b0f2adfa2 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:17.576423 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e80aaa74-36cb-4c25-8538-47e4c2d18893 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:17.577319 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e80aaa74-36cb-4c25-8538-47e4c2d18893 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:17.579848 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a5c7e221-cd75-41d5-a431-2e1b0f2adfa2 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:17.586313 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e80aaa74-36cb-4c25-8538-47e4c2d18893 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:17.587411 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e80aaa74-36cb-4c25-8538-47e4c2d18893 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:17.588780 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e80aaa74-36cb-4c25-8538-47e4c2d18893 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:17.589576 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e80aaa74-36cb-4c25-8538-47e4c2d18893 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:17.635733 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a5c7e221-cd75-41d5-a431-2e1b0f2adfa2 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Going to try to terminate instance {{(pid=128719) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:39:17.785216 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-e80aaa74-36cb-4c25-8538-47e4c2d18893 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:17.797248 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e80aaa74-36cb-4c25-8538-47e4c2d18893 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1510 microversion: 2.1 time: 0.225203 Jan 10 11:39:17.798724 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 178/349] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:17 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:17.938578 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c18f281a-6ec6-41e9-b03e-9cded175fe2b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:17.939808 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c18f281a-6ec6-41e9-b03e-9cded175fe2b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:17.949178 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c18f281a-6ec6-41e9-b03e-9cded175fe2b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:17.949722 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c18f281a-6ec6-41e9-b03e-9cded175fe2b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:17.950662 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c18f281a-6ec6-41e9-b03e-9cded175fe2b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:17.951157 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c18f281a-6ec6-41e9-b03e-9cded175fe2b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:18.062367 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c18f281a-6ec6-41e9-b03e-9cded175fe2b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 31798 microversion: 2.20 time: 0.133418 Jan 10 11:39:18.063037 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 179/350] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:17 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 31798 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 11:39:18.074872 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-6093a9d4-f96f-40eb-912e-6d6c4a041689 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:18.075575 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-6093a9d4-f96f-40eb-912e-6d6c4a041689 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:18.082841 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6093a9d4-f96f-40eb-912e-6d6c4a041689 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:18.083298 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6093a9d4-f96f-40eb-912e-6d6c4a041689 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:18.084098 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6093a9d4-f96f-40eb-912e-6d6c4a041689 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:18.084532 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6093a9d4-f96f-40eb-912e-6d6c4a041689 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:18.262059 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-6093a9d4-f96f-40eb-912e-6d6c4a041689 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:18.269561 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-6093a9d4-f96f-40eb-912e-6d6c4a041689 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1318 microversion: 2.1 time: 0.199416 Jan 10 11:39:18.270114 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 180/351] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:18 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:39:18.276881 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4b4c60cc-4523-4330-8535-a91747ba44cc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:18.279452 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4b4c60cc-4523-4330-8535-a91747ba44cc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:18.298429 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4b4c60cc-4523-4330-8535-a91747ba44cc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:18.299175 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4b4c60cc-4523-4330-8535-a91747ba44cc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:18.301040 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4b4c60cc-4523-4330-8535-a91747ba44cc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:18.301679 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4b4c60cc-4523-4330-8535-a91747ba44cc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:18.480919 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4b4c60cc-4523-4330-8535-a91747ba44cc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 33916 microversion: 2.1 time: 0.209480 Jan 10 11:39:18.481824 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 181/352] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:18 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 33916 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:18.665225 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a5c7e221-cd75-41d5-a431-2e1b0f2adfa2 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 204 len: 0 microversion: 2.1 time: 1.120959 Jan 10 11:39:18.666043 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 172/353] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:39:17 2022] DELETE /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 0 bytes in 1127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:39:18.674398 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7d8e14a8-2d1b-4009-b568-20b727b0ce43 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:18.675102 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7d8e14a8-2d1b-4009-b568-20b727b0ce43 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:18.683712 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7d8e14a8-2d1b-4009-b568-20b727b0ce43 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:18.684272 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7d8e14a8-2d1b-4009-b568-20b727b0ce43 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:18.685216 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7d8e14a8-2d1b-4009-b568-20b727b0ce43 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:18.685735 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7d8e14a8-2d1b-4009-b568-20b727b0ce43 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:18.831009 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2c567148-aac9-40b9-83fc-c3eed2f146b4 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:18.840977 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2c567148-aac9-40b9-83fc-c3eed2f146b4 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:18.841689 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2c567148-aac9-40b9-83fc-c3eed2f146b4 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:18.842349 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2c567148-aac9-40b9-83fc-c3eed2f146b4 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:18.843404 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2c567148-aac9-40b9-83fc-c3eed2f146b4 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:18.844162 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2c567148-aac9-40b9-83fc-c3eed2f146b4 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:18.983132 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7d8e14a8-2d1b-4009-b568-20b727b0ce43 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:18.990941 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7d8e14a8-2d1b-4009-b568-20b727b0ce43 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1471 microversion: 2.1 time: 0.320462 Jan 10 11:39:18.991744 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 182/354] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:18 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1471 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:39:19.063471 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2c567148-aac9-40b9-83fc-c3eed2f146b4 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:19.077274 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-9fd657d4-a112-4695-8497-cd47fdfb784c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:19.077615 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2c567148-aac9-40b9-83fc-c3eed2f146b4 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1510 microversion: 2.1 time: 0.262733 Jan 10 11:39:19.078699 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 173/355] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:18 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1510 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:39:19.080177 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-9fd657d4-a112-4695-8497-cd47fdfb784c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:19.087556 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9fd657d4-a112-4695-8497-cd47fdfb784c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:19.088003 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9fd657d4-a112-4695-8497-cd47fdfb784c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:19.088799 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9fd657d4-a112-4695-8497-cd47fdfb784c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:19.089228 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9fd657d4-a112-4695-8497-cd47fdfb784c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:19.199229 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-9fd657d4-a112-4695-8497-cd47fdfb784c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 32270 microversion: 2.20 time: 0.126963 Jan 10 11:39:19.200068 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 183/356] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:19 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 32270 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:19.302777 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b0a9c0ce-0366-446b-acd4-fc2780c8a72b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:19.303422 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b0a9c0ce-0366-446b-acd4-fc2780c8a72b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:19.310150 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b0a9c0ce-0366-446b-acd4-fc2780c8a72b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:19.310738 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b0a9c0ce-0366-446b-acd4-fc2780c8a72b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:19.311530 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b0a9c0ce-0366-446b-acd4-fc2780c8a72b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:19.312138 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b0a9c0ce-0366-446b-acd4-fc2780c8a72b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:19.460039 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-b0a9c0ce-0366-446b-acd4-fc2780c8a72b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:19.468352 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b0a9c0ce-0366-446b-acd4-fc2780c8a72b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1318 microversion: 2.1 time: 0.169392 Jan 10 11:39:19.468618 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 174/357] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:19 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:19.498157 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7691021f-988c-41c4-96be-63f28cd3d293 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:19.499195 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7691021f-988c-41c4-96be-63f28cd3d293 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:19.509030 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7691021f-988c-41c4-96be-63f28cd3d293 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:19.509751 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7691021f-988c-41c4-96be-63f28cd3d293 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:19.510820 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7691021f-988c-41c4-96be-63f28cd3d293 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:19.511265 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7691021f-988c-41c4-96be-63f28cd3d293 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:19.644531 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7691021f-988c-41c4-96be-63f28cd3d293 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 34523 microversion: 2.1 time: 0.150397 Jan 10 11:39:19.645321 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 184/358] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:19 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 34523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:20.021192 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-6c7b6654-fcc9-4593-9040-9edfe346f008 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:20.021810 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-6c7b6654-fcc9-4593-9040-9edfe346f008 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:20.028308 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6c7b6654-fcc9-4593-9040-9edfe346f008 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:20.030799 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6c7b6654-fcc9-4593-9040-9edfe346f008 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:20.030799 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6c7b6654-fcc9-4593-9040-9edfe346f008 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:20.030799 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6c7b6654-fcc9-4593-9040-9edfe346f008 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:20.098824 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-92b5cbb6-0c8c-402a-8098-94bdea417ebf tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:20.100438 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-92b5cbb6-0c8c-402a-8098-94bdea417ebf tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:20.122265 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-92b5cbb6-0c8c-402a-8098-94bdea417ebf tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:20.122741 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-92b5cbb6-0c8c-402a-8098-94bdea417ebf tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:20.124115 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-92b5cbb6-0c8c-402a-8098-94bdea417ebf tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:20.125409 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-92b5cbb6-0c8c-402a-8098-94bdea417ebf tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:20.256195 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-6c7b6654-fcc9-4593-9040-9edfe346f008 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:20.268832 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-6c7b6654-fcc9-4593-9040-9edfe346f008 tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1471 microversion: 2.1 time: 0.252427 Jan 10 11:39:20.270240 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 175/359] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:20 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1471 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:20.287486 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-de032136-73da-4ba7-bfd2-504a8507ceda tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:20.293176 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-de032136-73da-4ba7-bfd2-504a8507ceda tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:20.312773 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-de032136-73da-4ba7-bfd2-504a8507ceda tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:20.313967 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-de032136-73da-4ba7-bfd2-504a8507ceda tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:20.315639 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-de032136-73da-4ba7-bfd2-504a8507ceda tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:20.319028 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-de032136-73da-4ba7-bfd2-504a8507ceda tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:20.379516 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-92b5cbb6-0c8c-402a-8098-94bdea417ebf tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:20.392058 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-92b5cbb6-0c8c-402a-8098-94bdea417ebf tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1516 microversion: 2.1 time: 0.299221 Jan 10 11:39:20.392850 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 185/360] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:20 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1516 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:20.461740 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-de032136-73da-4ba7-bfd2-504a8507ceda tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 32763 microversion: 2.20 time: 0.187403 Jan 10 11:39:20.463850 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 176/361] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:20 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 32763 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:20.492011 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f10f7e62-18df-442b-a41f-575fa7f16d56 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:20.492625 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f10f7e62-18df-442b-a41f-575fa7f16d56 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:20.499928 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f10f7e62-18df-442b-a41f-575fa7f16d56 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:20.500683 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f10f7e62-18df-442b-a41f-575fa7f16d56 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:20.501669 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f10f7e62-18df-442b-a41f-575fa7f16d56 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:20.502337 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f10f7e62-18df-442b-a41f-575fa7f16d56 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:20.657829 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e858e553-414e-4cdc-a9f8-1be2ad3e2e05 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:20.658915 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-e858e553-414e-4cdc-a9f8-1be2ad3e2e05 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:20.668571 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e858e553-414e-4cdc-a9f8-1be2ad3e2e05 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:20.669023 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e858e553-414e-4cdc-a9f8-1be2ad3e2e05 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:20.671165 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e858e553-414e-4cdc-a9f8-1be2ad3e2e05 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:20.671636 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e858e553-414e-4cdc-a9f8-1be2ad3e2e05 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:20.735555 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f10f7e62-18df-442b-a41f-575fa7f16d56 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:20.744470 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f10f7e62-18df-442b-a41f-575fa7f16d56 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1506 microversion: 2.1 time: 0.256645 Jan 10 11:39:20.755856 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 186/362] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:20 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:39:20.814332 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-e858e553-414e-4cdc-a9f8-1be2ad3e2e05 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 36279 microversion: 2.1 time: 0.159825 Jan 10 11:39:20.815623 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 177/363] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:20 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 36279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:39:21.307263 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-571dcbe6-f356-4bd9-8566-89636b20d53d tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:21.308108 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-571dcbe6-f356-4bd9-8566-89636b20d53d tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:21.315389 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-571dcbe6-f356-4bd9-8566-89636b20d53d tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:21.315843 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-571dcbe6-f356-4bd9-8566-89636b20d53d tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:21.316804 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-571dcbe6-f356-4bd9-8566-89636b20d53d tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:21.320339 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-571dcbe6-f356-4bd9-8566-89636b20d53d tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:21.489269 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b64870b1-e239-47f9-9401-74588248f3bd tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:21.497293 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b64870b1-e239-47f9-9401-74588248f3bd tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:21.589161 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b64870b1-e239-47f9-9401-74588248f3bd tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:21.589657 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b64870b1-e239-47f9-9401-74588248f3bd tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:21.590748 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b64870b1-e239-47f9-9401-74588248f3bd tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:21.592228 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b64870b1-e239-47f9-9401-74588248f3bd tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:21.623944 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-571dcbe6-f356-4bd9-8566-89636b20d53d tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:21.655742 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-571dcbe6-f356-4bd9-8566-89636b20d53d tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1471 microversion: 2.1 time: 0.352692 Jan 10 11:39:21.657713 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 187/364] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:21 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1471 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:21.772649 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b64870b1-e239-47f9-9401-74588248f3bd tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 33221 microversion: 2.20 time: 0.295120 Jan 10 11:39:21.774112 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 178/365] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:21 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 33221 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:21.827745 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a22b44a8-bd5b-4055-ad82-5e7f62e86398 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:21.828966 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a22b44a8-bd5b-4055-ad82-5e7f62e86398 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:21.839740 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a22b44a8-bd5b-4055-ad82-5e7f62e86398 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:21.840603 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a22b44a8-bd5b-4055-ad82-5e7f62e86398 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:21.841925 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a22b44a8-bd5b-4055-ad82-5e7f62e86398 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:21.842733 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a22b44a8-bd5b-4055-ad82-5e7f62e86398 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:21.956679 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a22b44a8-bd5b-4055-ad82-5e7f62e86398 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 37437 microversion: 2.1 time: 0.131843 Jan 10 11:39:21.962232 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 188/366] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:21 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 37437 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:22.685448 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a3979a04-5e28-4e9b-87b6-76ba78a4e07c tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:22.686161 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a3979a04-5e28-4e9b-87b6-76ba78a4e07c tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:22.698296 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a3979a04-5e28-4e9b-87b6-76ba78a4e07c tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:22.698952 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a3979a04-5e28-4e9b-87b6-76ba78a4e07c tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:22.709191 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-9ef03e02-d7a3-4c60-9911-1c7a9107cdeb req-f33fb2f9-026b-45da-9bd7-c73cc9c4393e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b8fbd4-4073-4498-9498-b440d643398a", "name": "network-vif-deleted", "tag": "8c90115a-1680-4748-a6c3-094a2793bb13"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:22.709898 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a3979a04-5e28-4e9b-87b6-76ba78a4e07c tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:22.712152 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a3979a04-5e28-4e9b-87b6-76ba78a4e07c tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:22.713836 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:39:22.713836 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:39:22.722802 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-9ef03e02-d7a3-4c60-9911-1c7a9107cdeb req-f33fb2f9-026b-45da-9bd7-c73cc9c4393e service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:22.723250 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-9ef03e02-d7a3-4c60-9911-1c7a9107cdeb req-f33fb2f9-026b-45da-9bd7-c73cc9c4393e service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:22.768107 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-9ef03e02-d7a3-4c60-9911-1c7a9107cdeb req-f33fb2f9-026b-45da-9bd7-c73cc9c4393e service nova] Creating event network-vif-deleted:8c90115a-1680-4748-a6c3-094a2793bb13 for instance e5b8fbd4-4073-4498-9498-b440d643398a on hv-cinder-maste Jan 10 11:39:22.775676 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-9ef03e02-d7a3-4c60-9911-1c7a9107cdeb req-f33fb2f9-026b-45da-9bd7-c73cc9c4393e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073211 Jan 10 11:39:22.778449 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 189/367] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:39:22.807896 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-379df63f-b9d9-4dbc-841e-1aaa69694b4e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:22.809224 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-379df63f-b9d9-4dbc-841e-1aaa69694b4e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:22.832241 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a3979a04-5e28-4e9b-87b6-76ba78a4e07c tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:22.837679 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-379df63f-b9d9-4dbc-841e-1aaa69694b4e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:22.839201 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-379df63f-b9d9-4dbc-841e-1aaa69694b4e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:22.840959 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-379df63f-b9d9-4dbc-841e-1aaa69694b4e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:22.842021 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-379df63f-b9d9-4dbc-841e-1aaa69694b4e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:22.852965 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a3979a04-5e28-4e9b-87b6-76ba78a4e07c tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1429 microversion: 2.1 time: 0.174160 Jan 10 11:39:22.854109 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 179/368] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:22 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1429 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:22.878638 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-0b842f4b-9b42-494b-b55a-4cbac657c5ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:22.881554 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-0b842f4b-9b42-494b-b55a-4cbac657c5ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:22.895092 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0b842f4b-9b42-494b-b55a-4cbac657c5ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:22.895903 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0b842f4b-9b42-494b-b55a-4cbac657c5ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:22.897869 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0b842f4b-9b42-494b-b55a-4cbac657c5ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:22.899262 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0b842f4b-9b42-494b-b55a-4cbac657c5ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:23.022855 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-0b842f4b-9b42-494b-b55a-4cbac657c5ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 33880 microversion: 2.20 time: 0.153563 Jan 10 11:39:23.024561 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 180/369] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:22 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 33880 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:23.031044 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9a3d2810-1838-43a4-b332-0aa0bdb7fa72 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:23.033107 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9a3d2810-1838-43a4-b332-0aa0bdb7fa72 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:23.041366 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9a3d2810-1838-43a4-b332-0aa0bdb7fa72 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:23.041824 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9a3d2810-1838-43a4-b332-0aa0bdb7fa72 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:23.042887 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9a3d2810-1838-43a4-b332-0aa0bdb7fa72 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:23.043516 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9a3d2810-1838-43a4-b332-0aa0bdb7fa72 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:23.145672 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9a3d2810-1838-43a4-b332-0aa0bdb7fa72 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 38076 microversion: 2.1 time: 0.118868 Jan 10 11:39:23.147827 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 181/370] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:23 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 38076 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:23.254169 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-379df63f-b9d9-4dbc-841e-1aaa69694b4e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:23.263469 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-379df63f-b9d9-4dbc-841e-1aaa69694b4e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1516 microversion: 2.1 time: 0.482008 Jan 10 11:39:23.264050 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 190/371] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:22 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1516 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:23.286445 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-c3326a81-a143-4ca5-85e9-39e59e8c7aae tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2097ecd5-5982-4ba9-b10f-dc5138579eb5"}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:23.288598 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-c3326a81-a143-4ca5-85e9-39e59e8c7aae tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:23.298838 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c3326a81-a143-4ca5-85e9-39e59e8c7aae tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:23.299661 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c3326a81-a143-4ca5-85e9-39e59e8c7aae tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:23.301119 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c3326a81-a143-4ca5-85e9-39e59e8c7aae tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:23.301962 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c3326a81-a143-4ca5-85e9-39e59e8c7aae tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:23.879267 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ee2aa290-77ca-4263-9bee-204d41edaa6f tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:23.880162 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ee2aa290-77ca-4263-9bee-204d41edaa6f tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:23.887220 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ee2aa290-77ca-4263-9bee-204d41edaa6f tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:23.888039 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ee2aa290-77ca-4263-9bee-204d41edaa6f tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:23.889078 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ee2aa290-77ca-4263-9bee-204d41edaa6f tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:23.889746 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ee2aa290-77ca-4263-9bee-204d41edaa6f tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:23.961384 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ee2aa290-77ca-4263-9bee-204d41edaa6f tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:23.961384 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ee2aa290-77ca-4263-9bee-204d41edaa6f tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:23.961384 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.objects.instance [None req-ee2aa290-77ca-4263-9bee-204d41edaa6f tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lazy-loading 'fault' on Instance uuid e5b8fbd4-4073-4498-9498-b440d643398a {{(pid=128718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:39:24.048261 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ee2aa290-77ca-4263-9bee-204d41edaa6f tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbc21f8524046df82e09f3e5628213e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51d2f537a79a40f793f17573c3c26ba7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:24.064186 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ee2aa290-77ca-4263-9bee-204d41edaa6f tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 200 len: 1305 microversion: 2.1 time: 0.188623 Jan 10 11:39:24.064786 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 191/372] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:23 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 1305 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:24.071874 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-65b8d80c-b62d-4434-b6f2-8115c89b4c8a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:24.072865 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-65b8d80c-b62d-4434-b6f2-8115c89b4c8a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:24.079390 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-65b8d80c-b62d-4434-b6f2-8115c89b4c8a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:24.079984 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-65b8d80c-b62d-4434-b6f2-8115c89b4c8a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:24.080799 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-65b8d80c-b62d-4434-b6f2-8115c89b4c8a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:24.081240 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-65b8d80c-b62d-4434-b6f2-8115c89b4c8a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:24.189351 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-65b8d80c-b62d-4434-b6f2-8115c89b4c8a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 34698 microversion: 2.20 time: 0.122903 Jan 10 11:39:24.190043 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 192/373] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:24 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 34698 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:24.196052 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-445a2a35-c4dd-403b-a022-2290487958fc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30aa4559-1fb5-4456-9021-1d1b3c96b8ea"}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:24.197218 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-445a2a35-c4dd-403b-a022-2290487958fc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:24.204670 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-445a2a35-c4dd-403b-a022-2290487958fc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:24.205168 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-445a2a35-c4dd-403b-a022-2290487958fc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:24.206059 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-445a2a35-c4dd-403b-a022-2290487958fc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:24.206546 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-445a2a35-c4dd-403b-a022-2290487958fc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:24.661488 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-c3326a81-a143-4ca5-85e9-39e59e8c7aae tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "POST /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.383778 Jan 10 11:39:24.663508 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 182/374] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jan 10 11:39:23 2022] POST /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/os-volume_attachments => generated 194 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:39:24.673386 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d50ee6af-349f-46b4-a96f-d6a2c88d3434 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:24.674862 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d50ee6af-349f-46b4-a96f-d6a2c88d3434 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:24.689272 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d50ee6af-349f-46b4-a96f-d6a2c88d3434 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:24.689694 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d50ee6af-349f-46b4-a96f-d6a2c88d3434 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:24.697423 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d50ee6af-349f-46b4-a96f-d6a2c88d3434 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:24.700846 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d50ee6af-349f-46b4-a96f-d6a2c88d3434 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:24.793111 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d50ee6af-349f-46b4-a96f-d6a2c88d3434 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 38076 microversion: 2.1 time: 0.124001 Jan 10 11:39:24.794279 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 183/375] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:24 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 38076 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:25.115483 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-bd34b1d2-87f2-4d8b-ab54-ab537500b8ce tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:25.117339 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-bd34b1d2-87f2-4d8b-ab54-ab537500b8ce tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] [instance: e5b8fbd4-4073-4498-9498-b440d643398a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:25.135779 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bd34b1d2-87f2-4d8b-ab54-ab537500b8ce tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:25.136508 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bd34b1d2-87f2-4d8b-ab54-ab537500b8ce tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:25.142368 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bd34b1d2-87f2-4d8b-ab54-ab537500b8ce tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:25.149170 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bd34b1d2-87f2-4d8b-ab54-ab537500b8ce tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:25.170178 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-bd34b1d2-87f2-4d8b-ab54-ab537500b8ce tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] HTTP exception thrown: Instance e5b8fbd4-4073-4498-9498-b440d643398a could not be found. Jan 10 11:39:25.170809 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-bd34b1d2-87f2-4d8b-ab54-ab537500b8ce tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] Returning 404 to user: Instance e5b8fbd4-4073-4498-9498-b440d643398a could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:39:25.171655 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-bd34b1d2-87f2-4d8b-ab54-ab537500b8ce tempest-VolumesNegativeTest-971464161 tempest-VolumesNegativeTest-971464161-project] 10.222.0.20 "GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a" status: 404 len: 111 microversion: 2.1 time: 0.066738 Jan 10 11:39:25.172199 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 184/376] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:25 2022] GET /compute/v2.1/servers/e5b8fbd4-4073-4498-9498-b440d643398a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 10 11:39:25.207115 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d4dd05df-b207-4124-b7a7-b1ba76491d9a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:25.208060 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d4dd05df-b207-4124-b7a7-b1ba76491d9a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:25.215923 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d4dd05df-b207-4124-b7a7-b1ba76491d9a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:25.216374 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d4dd05df-b207-4124-b7a7-b1ba76491d9a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:25.217180 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d4dd05df-b207-4124-b7a7-b1ba76491d9a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:25.217619 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d4dd05df-b207-4124-b7a7-b1ba76491d9a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:25.299349 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d4dd05df-b207-4124-b7a7-b1ba76491d9a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 35446 microversion: 2.20 time: 0.099141 Jan 10 11:39:25.300703 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 185/377] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:25 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 35446 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:25.428163 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-445a2a35-c4dd-403b-a022-2290487958fc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "POST /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.236645 Jan 10 11:39:25.432147 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 193/378] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jan 10 11:39:24 2022] POST /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments => generated 194 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:39:25.809601 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-384faf9b-8f9f-4b54-b4e9-e3e63623a43d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:25.809601 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-384faf9b-8f9f-4b54-b4e9-e3e63623a43d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:25.828808 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-384faf9b-8f9f-4b54-b4e9-e3e63623a43d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:25.829456 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-384faf9b-8f9f-4b54-b4e9-e3e63623a43d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:25.830367 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-384faf9b-8f9f-4b54-b4e9-e3e63623a43d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:25.830992 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-384faf9b-8f9f-4b54-b4e9-e3e63623a43d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:25.906844 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-384faf9b-8f9f-4b54-b4e9-e3e63623a43d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 38076 microversion: 2.1 time: 0.105196 Jan 10 11:39:25.907776 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 186/379] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:25 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 38076 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:26.313617 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-005eb4f0-9098-4ba3-a947-8eaeeafdfa90 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:26.314574 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-005eb4f0-9098-4ba3-a947-8eaeeafdfa90 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:26.321887 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-005eb4f0-9098-4ba3-a947-8eaeeafdfa90 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:26.322381 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-005eb4f0-9098-4ba3-a947-8eaeeafdfa90 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:26.323371 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-005eb4f0-9098-4ba3-a947-8eaeeafdfa90 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:26.324017 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-005eb4f0-9098-4ba3-a947-8eaeeafdfa90 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:26.423892 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-005eb4f0-9098-4ba3-a947-8eaeeafdfa90 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 36464 microversion: 2.20 time: 0.114344 Jan 10 11:39:26.425560 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 194/380] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:26 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 36464 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:26.926108 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a67f28c0-2172-49ca-ad4e-4907dd563033 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:26.927470 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a67f28c0-2172-49ca-ad4e-4907dd563033 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:26.940749 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a67f28c0-2172-49ca-ad4e-4907dd563033 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:26.941499 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a67f28c0-2172-49ca-ad4e-4907dd563033 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:26.942396 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a67f28c0-2172-49ca-ad4e-4907dd563033 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:26.943124 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a67f28c0-2172-49ca-ad4e-4907dd563033 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:27.025136 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a67f28c0-2172-49ca-ad4e-4907dd563033 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 38076 microversion: 2.1 time: 0.104460 Jan 10 11:39:27.027608 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 187/381] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:26 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 38076 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:27.445852 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-99c84bf4-1459-4c2f-86d6-bad3aca112f4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:27.447836 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-99c84bf4-1459-4c2f-86d6-bad3aca112f4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:27.461235 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-99c84bf4-1459-4c2f-86d6-bad3aca112f4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:27.462041 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-99c84bf4-1459-4c2f-86d6-bad3aca112f4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:27.479668 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-99c84bf4-1459-4c2f-86d6-bad3aca112f4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:27.479668 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-99c84bf4-1459-4c2f-86d6-bad3aca112f4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:27.557969 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-99c84bf4-1459-4c2f-86d6-bad3aca112f4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 37382 microversion: 2.20 time: 0.119999 Jan 10 11:39:27.558935 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 195/382] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:27 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 37382 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:28.050627 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ac5e7e93-ea92-49cb-b615-fc0a34f8f9b8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:28.052185 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ac5e7e93-ea92-49cb-b615-fc0a34f8f9b8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:28.062116 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ac5e7e93-ea92-49cb-b615-fc0a34f8f9b8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:28.062116 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ac5e7e93-ea92-49cb-b615-fc0a34f8f9b8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:28.062116 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ac5e7e93-ea92-49cb-b615-fc0a34f8f9b8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:28.062116 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ac5e7e93-ea92-49cb-b615-fc0a34f8f9b8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:28.167758 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ac5e7e93-ea92-49cb-b615-fc0a34f8f9b8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 38200 microversion: 2.1 time: 0.120995 Jan 10 11:39:28.168577 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 188/383] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:28 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 38200 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:28.576526 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2c0583ba-e4be-4c20-bf22-33f54678666b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:28.577561 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2c0583ba-e4be-4c20-bf22-33f54678666b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:28.586542 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2c0583ba-e4be-4c20-bf22-33f54678666b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:28.587206 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2c0583ba-e4be-4c20-bf22-33f54678666b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:28.588137 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2c0583ba-e4be-4c20-bf22-33f54678666b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:28.588667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2c0583ba-e4be-4c20-bf22-33f54678666b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:28.686233 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2c0583ba-e4be-4c20-bf22-33f54678666b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 38142 microversion: 2.20 time: 0.113753 Jan 10 11:39:28.687272 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 196/384] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:28 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 38142 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:29.183264 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-1b44373b-9040-4132-9463-282aaa1be2e6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:29.184211 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-1b44373b-9040-4132-9463-282aaa1be2e6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:29.191513 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1b44373b-9040-4132-9463-282aaa1be2e6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:29.191964 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1b44373b-9040-4132-9463-282aaa1be2e6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:29.192756 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1b44373b-9040-4132-9463-282aaa1be2e6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:29.193193 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1b44373b-9040-4132-9463-282aaa1be2e6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:29.291991 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-1b44373b-9040-4132-9463-282aaa1be2e6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 200 len: 38207 microversion: 2.1 time: 0.113190 Jan 10 11:39:29.292639 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 189/385] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:29 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 38207 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:39:29.302971 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-65f8ed35-860e-4208-acf8-9421b0158bc8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:29.303553 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-65f8ed35-860e-4208-acf8-9421b0158bc8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:29.311304 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-65f8ed35-860e-4208-acf8-9421b0158bc8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:29.311780 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-65f8ed35-860e-4208-acf8-9421b0158bc8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:29.312779 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-65f8ed35-860e-4208-acf8-9421b0158bc8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:29.313492 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-65f8ed35-860e-4208-acf8-9421b0158bc8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:29.346245 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-65f8ed35-860e-4208-acf8-9421b0158bc8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/ips" status: 200 len: 143 microversion: 2.1 time: 0.047234 Jan 10 11:39:29.346849 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 197/386] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jan 10 11:39:29 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/ips => generated 143 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:39:29.700376 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-8c51daad-7c95-4a79-8a4c-86e5c6f6ad91 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:29.701400 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-8c51daad-7c95-4a79-8a4c-86e5c6f6ad91 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:29.708629 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8c51daad-7c95-4a79-8a4c-86e5c6f6ad91 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:29.709080 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8c51daad-7c95-4a79-8a4c-86e5c6f6ad91 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:29.709901 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8c51daad-7c95-4a79-8a4c-86e5c6f6ad91 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:29.710366 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8c51daad-7c95-4a79-8a4c-86e5c6f6ad91 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:29.789656 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-8c51daad-7c95-4a79-8a4c-86e5c6f6ad91 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 38142 microversion: 2.20 time: 0.093203 Jan 10 11:39:29.790924 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 190/387] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:29 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 38142 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:30.803351 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e304e640-f53c-4f7d-9b92-cc3b276f9115 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:30.804652 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e304e640-f53c-4f7d-9b92-cc3b276f9115 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:30.812375 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e304e640-f53c-4f7d-9b92-cc3b276f9115 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:30.812375 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e304e640-f53c-4f7d-9b92-cc3b276f9115 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:30.812995 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e304e640-f53c-4f7d-9b92-cc3b276f9115 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:30.813435 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e304e640-f53c-4f7d-9b92-cc3b276f9115 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:30.905841 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e304e640-f53c-4f7d-9b92-cc3b276f9115 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 200 len: 38285 microversion: 2.20 time: 0.106608 Jan 10 11:39:30.907358 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 198/388] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:30 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 38285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 11:39:30.919206 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-8acae6ec-4ca8-4828-a877-f48a2c47aff0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:30.922095 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-8acae6ec-4ca8-4828-a877-f48a2c47aff0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:30.930048 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8acae6ec-4ca8-4828-a877-f48a2c47aff0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:30.930798 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8acae6ec-4ca8-4828-a877-f48a2c47aff0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:30.931648 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8acae6ec-4ca8-4828-a877-f48a2c47aff0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:30.932047 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8acae6ec-4ca8-4828-a877-f48a2c47aff0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:30.960228 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-8acae6ec-4ca8-4828-a877-f48a2c47aff0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/ips" status: 200 len: 151 microversion: 2.20 time: 0.046891 Jan 10 11:39:30.961844 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 191/389] 10.222.0.20 () {60 vars in 1288 bytes} [Mon Jan 10 11:39:30 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:39:32.856064 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-10186c6c-52d2-4fa3-b9fd-9d7c3b05adda tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39a5a926-83bd-46b2-9abb-059ad0b99447"}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:32.857238 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-10186c6c-52d2-4fa3-b9fd-9d7c3b05adda tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:32.864581 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-10186c6c-52d2-4fa3-b9fd-9d7c3b05adda tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:32.865036 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-10186c6c-52d2-4fa3-b9fd-9d7c3b05adda tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:32.865841 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-10186c6c-52d2-4fa3-b9fd-9d7c3b05adda tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:32.866308 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-10186c6c-52d2-4fa3-b9fd-9d7c3b05adda tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:33.568778 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ce4059ce-5635-41b2-914e-14bceb03b5cc tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:33.570467 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ce4059ce-5635-41b2-914e-14bceb03b5cc tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:33.576919 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ce4059ce-5635-41b2-914e-14bceb03b5cc tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:33.577367 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ce4059ce-5635-41b2-914e-14bceb03b5cc tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:33.578157 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ce4059ce-5635-41b2-914e-14bceb03b5cc tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:33.578615 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ce4059ce-5635-41b2-914e-14bceb03b5cc tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:33.603406 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-ce4059ce-5635-41b2-914e-14bceb03b5cc tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lazy-loading 'flavor' on Instance uuid 9bb75a87-2b05-43d3-b570-a04858874b50 {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:39:34.468474 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ce4059ce-5635-41b2-914e-14bceb03b5cc tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "POST /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/action" status: 200 len: 32 microversion: 2.1 time: 0.903552 Jan 10 11:39:34.469322 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 192/390] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:33 2022] POST /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/action => generated 32 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:39:34.483961 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-8cea86a8-eb05-4292-a2b4-a4c2e8f9caa9 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:34.484857 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-8cea86a8-eb05-4292-a2b4-a4c2e8f9caa9 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:34.498750 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8cea86a8-eb05-4292-a2b4-a4c2e8f9caa9 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:34.498750 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8cea86a8-eb05-4292-a2b4-a4c2e8f9caa9 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:34.498750 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8cea86a8-eb05-4292-a2b4-a4c2e8f9caa9 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:34.498750 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8cea86a8-eb05-4292-a2b4-a4c2e8f9caa9 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:34.657759 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-8cea86a8-eb05-4292-a2b4-a4c2e8f9caa9 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:34.668271 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-8cea86a8-eb05-4292-a2b4-a4c2e8f9caa9 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.188947 Jan 10 11:39:34.668852 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 193/391] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:34 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:39:34.673581 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-51ee70b5-6a11-4a53-ba74-ef6a7463359f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:34.674372 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-51ee70b5-6a11-4a53-ba74-ef6a7463359f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:34.680868 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-51ee70b5-6a11-4a53-ba74-ef6a7463359f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:34.681587 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-51ee70b5-6a11-4a53-ba74-ef6a7463359f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:34.682436 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-51ee70b5-6a11-4a53-ba74-ef6a7463359f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:34.682968 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-51ee70b5-6a11-4a53-ba74-ef6a7463359f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:34.711130 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-51ee70b5-6a11-4a53-ba74-ef6a7463359f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lazy-loading 'flavor' on Instance uuid bb58298d-9795-4c2b-86b6-3b17b668765f {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:39:34.814581 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-10186c6c-52d2-4fa3-b9fd-9d7c3b05adda tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.961573 Jan 10 11:39:34.814581 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 199/392] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jan 10 11:39:32 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/os-volume_attachments => generated 194 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:39:35.414163 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-51ee70b5-6a11-4a53-ba74-ef6a7463359f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 202 len: 0 microversion: 2.20 time: 0.743820 Jan 10 11:39:35.424588 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2fe79ca5-900f-48c2-b590-001c8b08b4d6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:35.425290 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2fe79ca5-900f-48c2-b590-001c8b08b4d6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:35.430409 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 194/393] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:39:34 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:39:35.434513 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2fe79ca5-900f-48c2-b590-001c8b08b4d6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:35.436720 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2fe79ca5-900f-48c2-b590-001c8b08b4d6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:35.436720 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2fe79ca5-900f-48c2-b590-001c8b08b4d6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:35.436720 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2fe79ca5-900f-48c2-b590-001c8b08b4d6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:35.603248 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2fe79ca5-900f-48c2-b590-001c8b08b4d6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:35.612514 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2fe79ca5-900f-48c2-b590-001c8b08b4d6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:35.614532 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2fe79ca5-900f-48c2-b590-001c8b08b4d6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:35.615756 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2fe79ca5-900f-48c2-b590-001c8b08b4d6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.196202 Jan 10 11:39:35.616334 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 200/394] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:35 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:39:35.687430 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-683c5036-e0f1-45ec-9edd-a995cc459f89 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:35.688731 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-683c5036-e0f1-45ec-9edd-a995cc459f89 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:35.696402 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-683c5036-e0f1-45ec-9edd-a995cc459f89 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:35.696852 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-683c5036-e0f1-45ec-9edd-a995cc459f89 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:35.697655 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-683c5036-e0f1-45ec-9edd-a995cc459f89 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:35.698162 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-683c5036-e0f1-45ec-9edd-a995cc459f89 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:35.850351 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-683c5036-e0f1-45ec-9edd-a995cc459f89 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:35.858776 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-683c5036-e0f1-45ec-9edd-a995cc459f89 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.176003 Jan 10 11:39:35.869424 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 195/395] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:35 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:36.637747 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3eb16247-9bb8-46ed-be87-2b65e235a79c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:36.638605 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3eb16247-9bb8-46ed-be87-2b65e235a79c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:36.645094 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3eb16247-9bb8-46ed-be87-2b65e235a79c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:36.645551 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3eb16247-9bb8-46ed-be87-2b65e235a79c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:36.646388 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3eb16247-9bb8-46ed-be87-2b65e235a79c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:36.646831 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3eb16247-9bb8-46ed-be87-2b65e235a79c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:36.787183 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3eb16247-9bb8-46ed-be87-2b65e235a79c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:36.796468 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3eb16247-9bb8-46ed-be87-2b65e235a79c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:36.797684 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3eb16247-9bb8-46ed-be87-2b65e235a79c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:36.798899 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3eb16247-9bb8-46ed-be87-2b65e235a79c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.166211 Jan 10 11:39:36.799467 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 201/396] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:36 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:39:36.876333 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-89427dd8-42da-435d-b34a-944b2beee4f8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:36.877072 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-89427dd8-42da-435d-b34a-944b2beee4f8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:36.886969 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-89427dd8-42da-435d-b34a-944b2beee4f8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:36.887215 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-89427dd8-42da-435d-b34a-944b2beee4f8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:36.888003 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-89427dd8-42da-435d-b34a-944b2beee4f8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:36.888436 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-89427dd8-42da-435d-b34a-944b2beee4f8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:37.068294 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-89427dd8-42da-435d-b34a-944b2beee4f8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:37.078400 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-89427dd8-42da-435d-b34a-944b2beee4f8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.205643 Jan 10 11:39:37.078989 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 196/397] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:36 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:37.817016 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-5f343a89-6210-4ec2-afeb-5893d1da3d4b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:37.817638 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-5f343a89-6210-4ec2-afeb-5893d1da3d4b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:37.824690 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5f343a89-6210-4ec2-afeb-5893d1da3d4b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:37.825059 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5f343a89-6210-4ec2-afeb-5893d1da3d4b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:37.825859 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5f343a89-6210-4ec2-afeb-5893d1da3d4b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:37.826964 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5f343a89-6210-4ec2-afeb-5893d1da3d4b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:38.008535 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-5f343a89-6210-4ec2-afeb-5893d1da3d4b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:38.021230 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-5f343a89-6210-4ec2-afeb-5893d1da3d4b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:38.023005 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-5f343a89-6210-4ec2-afeb-5893d1da3d4b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:38.025507 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-5f343a89-6210-4ec2-afeb-5893d1da3d4b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.212403 Jan 10 11:39:38.026760 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 202/398] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:37 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:39:38.096355 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9134033a-7858-4366-b655-38c00de4e005 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:38.097098 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9134033a-7858-4366-b655-38c00de4e005 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:38.105053 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9134033a-7858-4366-b655-38c00de4e005 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:38.105511 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9134033a-7858-4366-b655-38c00de4e005 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:38.106344 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9134033a-7858-4366-b655-38c00de4e005 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:38.106791 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9134033a-7858-4366-b655-38c00de4e005 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:38.261621 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9134033a-7858-4366-b655-38c00de4e005 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:38.269720 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9134033a-7858-4366-b655-38c00de4e005 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.177408 Jan 10 11:39:38.270340 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 197/399] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:38 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:39.051938 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-20136583-9282-41ea-8a37-65e9abbce3ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:39.052568 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-20136583-9282-41ea-8a37-65e9abbce3ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:39.059696 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-20136583-9282-41ea-8a37-65e9abbce3ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:39.060151 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-20136583-9282-41ea-8a37-65e9abbce3ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:39.060946 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-20136583-9282-41ea-8a37-65e9abbce3ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:39.061385 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-20136583-9282-41ea-8a37-65e9abbce3ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:39.211277 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-20136583-9282-41ea-8a37-65e9abbce3ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:39.221973 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-20136583-9282-41ea-8a37-65e9abbce3ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:39.223584 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-20136583-9282-41ea-8a37-65e9abbce3ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:39.224804 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-20136583-9282-41ea-8a37-65e9abbce3ba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.176630 Jan 10 11:39:39.225697 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 203/400] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:39 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:39:39.291495 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-6f4fff78-f8bf-4e8b-a930-710599e1fe5f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:39.292429 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-6f4fff78-f8bf-4e8b-a930-710599e1fe5f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:39.302370 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6f4fff78-f8bf-4e8b-a930-710599e1fe5f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:39.309282 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6f4fff78-f8bf-4e8b-a930-710599e1fe5f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:39.309282 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6f4fff78-f8bf-4e8b-a930-710599e1fe5f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:39.309282 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6f4fff78-f8bf-4e8b-a930-710599e1fe5f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:39.458079 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-6f4fff78-f8bf-4e8b-a930-710599e1fe5f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:39.466624 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-6f4fff78-f8bf-4e8b-a930-710599e1fe5f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.181505 Jan 10 11:39:39.467257 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 198/401] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:39 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:40.243852 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-97783672-2e8d-4a59-8820-a86b34fc282d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:40.244604 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-97783672-2e8d-4a59-8820-a86b34fc282d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:40.261397 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-97783672-2e8d-4a59-8820-a86b34fc282d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:40.261397 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-97783672-2e8d-4a59-8820-a86b34fc282d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:40.261397 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-97783672-2e8d-4a59-8820-a86b34fc282d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:40.261397 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-97783672-2e8d-4a59-8820-a86b34fc282d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:40.483391 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-cb1493c5-cdbe-4d9f-bee7-38f70f07c649 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:40.484264 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-cb1493c5-cdbe-4d9f-bee7-38f70f07c649 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:40.493461 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-97783672-2e8d-4a59-8820-a86b34fc282d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:40.500030 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cb1493c5-cdbe-4d9f-bee7-38f70f07c649 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:40.503303 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-97783672-2e8d-4a59-8820-a86b34fc282d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:40.505075 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-97783672-2e8d-4a59-8820-a86b34fc282d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:40.505809 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cb1493c5-cdbe-4d9f-bee7-38f70f07c649 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:40.506794 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cb1493c5-cdbe-4d9f-bee7-38f70f07c649 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:40.506935 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-97783672-2e8d-4a59-8820-a86b34fc282d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.267257 Jan 10 11:39:40.507631 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 204/402] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:40 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:39:40.508331 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cb1493c5-cdbe-4d9f-bee7-38f70f07c649 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:40.644293 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-cb1493c5-cdbe-4d9f-bee7-38f70f07c649 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:40.652771 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-cb1493c5-cdbe-4d9f-bee7-38f70f07c649 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.172939 Jan 10 11:39:40.653601 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 199/403] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:40 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:41.525426 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-20d474f7-bb6a-4220-8bf0-f9e710e590ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:41.532648 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-20d474f7-bb6a-4220-8bf0-f9e710e590ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:41.532648 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-20d474f7-bb6a-4220-8bf0-f9e710e590ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:41.533131 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-20d474f7-bb6a-4220-8bf0-f9e710e590ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:41.534025 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-20d474f7-bb6a-4220-8bf0-f9e710e590ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:41.534506 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-20d474f7-bb6a-4220-8bf0-f9e710e590ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:41.670881 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-cc795491-0f4d-4baf-aef3-129be75b58bf tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:41.672180 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-cc795491-0f4d-4baf-aef3-129be75b58bf tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:41.681022 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cc795491-0f4d-4baf-aef3-129be75b58bf tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:41.682107 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cc795491-0f4d-4baf-aef3-129be75b58bf tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:41.683153 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cc795491-0f4d-4baf-aef3-129be75b58bf tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:41.683753 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cc795491-0f4d-4baf-aef3-129be75b58bf tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:42.145683 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-20d474f7-bb6a-4220-8bf0-f9e710e590ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:42.155498 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-20d474f7-bb6a-4220-8bf0-f9e710e590ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:42.157363 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-20d474f7-bb6a-4220-8bf0-f9e710e590ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:42.158802 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-20d474f7-bb6a-4220-8bf0-f9e710e590ea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.637812 Jan 10 11:39:42.159444 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 205/404] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:41 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:39:42.200258 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-cc795491-0f4d-4baf-aef3-129be75b58bf tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:42.208453 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-cc795491-0f4d-4baf-aef3-129be75b58bf tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.541708 Jan 10 11:39:42.209354 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 200/405] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:41 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:39:43.181152 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0dac2fb6-72ec-4a0b-9836-c706b94b0ea8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:43.182115 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0dac2fb6-72ec-4a0b-9836-c706b94b0ea8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:43.189207 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0dac2fb6-72ec-4a0b-9836-c706b94b0ea8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:43.189664 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0dac2fb6-72ec-4a0b-9836-c706b94b0ea8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:43.190508 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0dac2fb6-72ec-4a0b-9836-c706b94b0ea8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:43.191086 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0dac2fb6-72ec-4a0b-9836-c706b94b0ea8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:43.228610 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d6fe3577-cced-4159-8fcc-4eaf40a2b9a8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:43.229960 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d6fe3577-cced-4159-8fcc-4eaf40a2b9a8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:43.236856 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d6fe3577-cced-4159-8fcc-4eaf40a2b9a8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:43.238927 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d6fe3577-cced-4159-8fcc-4eaf40a2b9a8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:43.240178 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d6fe3577-cced-4159-8fcc-4eaf40a2b9a8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:43.240791 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d6fe3577-cced-4159-8fcc-4eaf40a2b9a8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:43.599078 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-d6fe3577-cced-4159-8fcc-4eaf40a2b9a8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:43.599291 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0dac2fb6-72ec-4a0b-9836-c706b94b0ea8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:43.599392 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d6fe3577-cced-4159-8fcc-4eaf40a2b9a8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.370651 Jan 10 11:39:43.599469 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0dac2fb6-72ec-4a0b-9836-c706b94b0ea8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:43.599549 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 201/406] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:43 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:43.599619 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0dac2fb6-72ec-4a0b-9836-c706b94b0ea8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:43.599619 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0dac2fb6-72ec-4a0b-9836-c706b94b0ea8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.422190 Jan 10 11:39:43.599619 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 206/407] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:43 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:39:43.815230 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-347c4c5b-6f74-4252-806e-d9879644daff tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30aa4559-1fb5-4456-9021-1d1b3c96b8ea"}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:43.819662 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-347c4c5b-6f74-4252-806e-d9879644daff tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:43.827908 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-347c4c5b-6f74-4252-806e-d9879644daff tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:43.828362 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-347c4c5b-6f74-4252-806e-d9879644daff tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:43.829313 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-347c4c5b-6f74-4252-806e-d9879644daff tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:43.829752 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-347c4c5b-6f74-4252-806e-d9879644daff tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:44.362437 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-347c4c5b-6f74-4252-806e-d9879644daff tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] HTTP exception thrown: Invalid volume: volume 30aa4559-1fb5-4456-9021-1d1b3c96b8ea is already attached to instances: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96 Jan 10 11:39:44.364151 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-347c4c5b-6f74-4252-806e-d9879644daff tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Returning 400 to user: Invalid volume: volume 30aa4559-1fb5-4456-9021-1d1b3c96b8ea is already attached to instances: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96 {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:39:44.366825 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-347c4c5b-6f74-4252-806e-d9879644daff tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "POST /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.556649 Jan 10 11:39:44.368444 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 202/408] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jan 10 11:39:43 2022] POST /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments => generated 174 bytes in 559 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 10 11:39:44.513982 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-90b601a9-835b-466e-9188-a2e9f3e70b22 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:44.514694 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-90b601a9-835b-466e-9188-a2e9f3e70b22 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:44.524307 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-90b601a9-835b-466e-9188-a2e9f3e70b22 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:44.527411 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-90b601a9-835b-466e-9188-a2e9f3e70b22 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:44.528310 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-90b601a9-835b-466e-9188-a2e9f3e70b22 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:44.528778 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-90b601a9-835b-466e-9188-a2e9f3e70b22 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:44.628417 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3e5916e9-465a-4120-80c1-e99a871f5b6e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:44.628417 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-3e5916e9-465a-4120-80c1-e99a871f5b6e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:44.628417 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3e5916e9-465a-4120-80c1-e99a871f5b6e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:44.628417 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3e5916e9-465a-4120-80c1-e99a871f5b6e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:44.628897 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3e5916e9-465a-4120-80c1-e99a871f5b6e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:44.628897 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3e5916e9-465a-4120-80c1-e99a871f5b6e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:44.859172 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-3e5916e9-465a-4120-80c1-e99a871f5b6e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:44.868597 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3e5916e9-465a-4120-80c1-e99a871f5b6e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.260509 Jan 10 11:39:44.869466 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 203/409] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:44 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:39:44.874253 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-34ffbe91-7341-4960-8bfe-39088925129f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:44.875307 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-34ffbe91-7341-4960-8bfe-39088925129f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:44.882090 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-34ffbe91-7341-4960-8bfe-39088925129f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:44.884988 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-34ffbe91-7341-4960-8bfe-39088925129f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:44.885363 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-34ffbe91-7341-4960-8bfe-39088925129f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:44.885813 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-34ffbe91-7341-4960-8bfe-39088925129f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:45.100225 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.objects.instance [None req-90b601a9-835b-466e-9188-a2e9f3e70b22 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lazy-loading 'services' on Instance uuid 9ff525c9-af1a-4b34-9c03-56f07ebd1d96 {{(pid=128718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:39:45.355753 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-34ffbe91-7341-4960-8bfe-39088925129f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:45.364968 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-34ffbe91-7341-4960-8bfe-39088925129f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:45.366558 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-34ffbe91-7341-4960-8bfe-39088925129f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:45.367947 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-34ffbe91-7341-4960-8bfe-39088925129f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.497186 Jan 10 11:39:45.368605 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 204/410] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:44 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:39:45.736806 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-90b601a9-835b-466e-9188-a2e9f3e70b22 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments/30aa4559-1fb5-4456-9021-1d1b3c96b8ea" status: 202 len: 0 microversion: 2.1 time: 1.226398 Jan 10 11:39:45.737822 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 207/411] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jan 10 11:39:44 2022] DELETE /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments/30aa4559-1fb5-4456-9021-1d1b3c96b8ea => generated 0 bytes in 1229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:45.755098 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-315b39ce-bd9a-4d78-ad02-2df03f1e3672 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:45.763049 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-315b39ce-bd9a-4d78-ad02-2df03f1e3672 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:45.770156 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-315b39ce-bd9a-4d78-ad02-2df03f1e3672 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:45.770977 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-315b39ce-bd9a-4d78-ad02-2df03f1e3672 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:45.773011 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-315b39ce-bd9a-4d78-ad02-2df03f1e3672 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:45.776637 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-315b39ce-bd9a-4d78-ad02-2df03f1e3672 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:45.820098 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-315b39ce-bd9a-4d78-ad02-2df03f1e3672 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077054 Jan 10 11:39:45.822012 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 205/412] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:39:45 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:39:45.894945 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8103b77d-1024-42fd-8516-21818a6fbe7b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:45.896705 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-8103b77d-1024-42fd-8516-21818a6fbe7b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:45.915533 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8103b77d-1024-42fd-8516-21818a6fbe7b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:45.917868 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8103b77d-1024-42fd-8516-21818a6fbe7b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:45.918265 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8103b77d-1024-42fd-8516-21818a6fbe7b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:45.920256 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8103b77d-1024-42fd-8516-21818a6fbe7b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:46.226358 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-8103b77d-1024-42fd-8516-21818a6fbe7b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:46.238031 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-8103b77d-1024-42fd-8516-21818a6fbe7b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.356644 Jan 10 11:39:46.248791 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 208/413] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:45 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:46.386660 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-980652e2-a8bb-4e3e-a9a2-3abf2ff74c22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:46.388017 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-980652e2-a8bb-4e3e-a9a2-3abf2ff74c22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:46.395203 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-980652e2-a8bb-4e3e-a9a2-3abf2ff74c22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:46.395687 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-980652e2-a8bb-4e3e-a9a2-3abf2ff74c22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:46.396702 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-980652e2-a8bb-4e3e-a9a2-3abf2ff74c22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:46.397185 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-980652e2-a8bb-4e3e-a9a2-3abf2ff74c22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:46.691905 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-980652e2-a8bb-4e3e-a9a2-3abf2ff74c22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:46.714573 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-980652e2-a8bb-4e3e-a9a2-3abf2ff74c22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:46.717172 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-980652e2-a8bb-4e3e-a9a2-3abf2ff74c22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:46.718789 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-980652e2-a8bb-4e3e-a9a2-3abf2ff74c22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.336096 Jan 10 11:39:46.726454 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 206/414] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:46 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:39:46.844519 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-d718ad8d-21f2-4d7f-ba42-38ae3a3f15ea tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:46.844519 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-d718ad8d-21f2-4d7f-ba42-38ae3a3f15ea tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:46.851432 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d718ad8d-21f2-4d7f-ba42-38ae3a3f15ea tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:46.851977 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d718ad8d-21f2-4d7f-ba42-38ae3a3f15ea tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:46.852833 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d718ad8d-21f2-4d7f-ba42-38ae3a3f15ea tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:46.853595 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d718ad8d-21f2-4d7f-ba42-38ae3a3f15ea tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:46.893164 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-d718ad8d-21f2-4d7f-ba42-38ae3a3f15ea tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063691 Jan 10 11:39:46.898962 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 209/415] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:39:46 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:39:47.257425 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-c7fa11e3-3dd1-4218-8d92-a3086f41823f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:47.262064 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-c7fa11e3-3dd1-4218-8d92-a3086f41823f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:47.269331 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c7fa11e3-3dd1-4218-8d92-a3086f41823f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:47.269790 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c7fa11e3-3dd1-4218-8d92-a3086f41823f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:47.270648 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c7fa11e3-3dd1-4218-8d92-a3086f41823f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:47.271090 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c7fa11e3-3dd1-4218-8d92-a3086f41823f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:47.422698 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-c7fa11e3-3dd1-4218-8d92-a3086f41823f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:47.431649 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-c7fa11e3-3dd1-4218-8d92-a3086f41823f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.179572 Jan 10 11:39:47.432244 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 207/416] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:47 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:47.741108 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-339d7b06-a220-406b-a0b0-9b6c9b9feaa2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:47.745712 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-339d7b06-a220-406b-a0b0-9b6c9b9feaa2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:47.749752 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-339d7b06-a220-406b-a0b0-9b6c9b9feaa2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:47.750505 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-339d7b06-a220-406b-a0b0-9b6c9b9feaa2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:47.751518 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-339d7b06-a220-406b-a0b0-9b6c9b9feaa2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:47.752163 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-339d7b06-a220-406b-a0b0-9b6c9b9feaa2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:47.907510 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-1e47868c-1280-4e45-8b2f-03ec088d329c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:47.908846 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-1e47868c-1280-4e45-8b2f-03ec088d329c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:47.922565 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1e47868c-1280-4e45-8b2f-03ec088d329c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:47.922565 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1e47868c-1280-4e45-8b2f-03ec088d329c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:47.922565 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1e47868c-1280-4e45-8b2f-03ec088d329c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:47.922565 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1e47868c-1280-4e45-8b2f-03ec088d329c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:47.968092 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-1e47868c-1280-4e45-8b2f-03ec088d329c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065499 Jan 10 11:39:47.978268 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-339d7b06-a220-406b-a0b0-9b6c9b9feaa2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:47.978771 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 208/417] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:39:47 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:39:47.989435 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-339d7b06-a220-406b-a0b0-9b6c9b9feaa2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:47.991464 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-339d7b06-a220-406b-a0b0-9b6c9b9feaa2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:47.993138 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-339d7b06-a220-406b-a0b0-9b6c9b9feaa2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.256969 Jan 10 11:39:47.993868 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 210/418] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:47 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:39:48.450196 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-1a02e77d-061a-4e5e-8015-5f55b85baeb0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:48.451555 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-1a02e77d-061a-4e5e-8015-5f55b85baeb0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:48.463144 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1a02e77d-061a-4e5e-8015-5f55b85baeb0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:48.463631 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1a02e77d-061a-4e5e-8015-5f55b85baeb0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:48.464455 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1a02e77d-061a-4e5e-8015-5f55b85baeb0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:48.464895 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1a02e77d-061a-4e5e-8015-5f55b85baeb0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:48.642318 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-1a02e77d-061a-4e5e-8015-5f55b85baeb0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:48.652656 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-1a02e77d-061a-4e5e-8015-5f55b85baeb0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.207374 Jan 10 11:39:48.665785 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 209/419] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:48 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:48.981934 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-729ac6ef-33c9-4533-935f-3177bae67faa tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:48.982519 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-729ac6ef-33c9-4533-935f-3177bae67faa tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:48.989557 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-729ac6ef-33c9-4533-935f-3177bae67faa tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:48.990196 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-729ac6ef-33c9-4533-935f-3177bae67faa tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:48.991209 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-729ac6ef-33c9-4533-935f-3177bae67faa tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:48.991949 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-729ac6ef-33c9-4533-935f-3177bae67faa tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:49.012885 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-788f3f62-709d-4747-b9d5-ff2addaccba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:49.014063 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-788f3f62-709d-4747-b9d5-ff2addaccba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:49.020697 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-788f3f62-709d-4747-b9d5-ff2addaccba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:49.021138 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-788f3f62-709d-4747-b9d5-ff2addaccba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:49.022170 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-788f3f62-709d-4747-b9d5-ff2addaccba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:49.022800 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-788f3f62-709d-4747-b9d5-ff2addaccba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:49.029150 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-729ac6ef-33c9-4533-935f-3177bae67faa tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051800 Jan 10 11:39:49.031721 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 211/420] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:39:48 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:39:49.185829 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-788f3f62-709d-4747-b9d5-ff2addaccba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:49.194263 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-788f3f62-709d-4747-b9d5-ff2addaccba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:49.196413 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-788f3f62-709d-4747-b9d5-ff2addaccba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:49.197624 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-788f3f62-709d-4747-b9d5-ff2addaccba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.189416 Jan 10 11:39:49.198198 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 210/421] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:49 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:39:49.682029 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-319ee3c9-4a36-42b3-8db7-ce730d9b5625 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:49.683285 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-319ee3c9-4a36-42b3-8db7-ce730d9b5625 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:49.693823 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-319ee3c9-4a36-42b3-8db7-ce730d9b5625 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:49.694540 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-319ee3c9-4a36-42b3-8db7-ce730d9b5625 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:49.695965 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-319ee3c9-4a36-42b3-8db7-ce730d9b5625 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:49.696500 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-319ee3c9-4a36-42b3-8db7-ce730d9b5625 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:49.945683 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-319ee3c9-4a36-42b3-8db7-ce730d9b5625 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:49.955465 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-319ee3c9-4a36-42b3-8db7-ce730d9b5625 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.278479 Jan 10 11:39:49.956625 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 212/422] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:49 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:50.043675 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f5f25dd5-6410-499d-8368-d2ca07336f5b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:50.044600 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f5f25dd5-6410-499d-8368-d2ca07336f5b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:50.050816 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f5f25dd5-6410-499d-8368-d2ca07336f5b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:50.051522 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f5f25dd5-6410-499d-8368-d2ca07336f5b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:50.052498 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f5f25dd5-6410-499d-8368-d2ca07336f5b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:50.052942 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f5f25dd5-6410-499d-8368-d2ca07336f5b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:50.085329 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f5f25dd5-6410-499d-8368-d2ca07336f5b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046158 Jan 10 11:39:50.085963 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 211/423] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:39:50 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:39:50.215927 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-69ba93a1-d0b7-419b-83e3-a1a7a6c7ce13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:50.216546 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-69ba93a1-d0b7-419b-83e3-a1a7a6c7ce13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:50.225851 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-69ba93a1-d0b7-419b-83e3-a1a7a6c7ce13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:50.227299 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-69ba93a1-d0b7-419b-83e3-a1a7a6c7ce13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:50.228323 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-69ba93a1-d0b7-419b-83e3-a1a7a6c7ce13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:50.228935 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-69ba93a1-d0b7-419b-83e3-a1a7a6c7ce13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:50.556923 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-69ba93a1-d0b7-419b-83e3-a1a7a6c7ce13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:50.566099 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-69ba93a1-d0b7-419b-83e3-a1a7a6c7ce13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:50.567753 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-69ba93a1-d0b7-419b-83e3-a1a7a6c7ce13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:50.569009 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-69ba93a1-d0b7-419b-83e3-a1a7a6c7ce13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.357373 Jan 10 11:39:50.569572 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 213/424] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:50 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:39:50.975482 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-88bed2ba-0828-4013-9a52-9cca27ed9df8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:50.981763 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-88bed2ba-0828-4013-9a52-9cca27ed9df8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:50.994725 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-88bed2ba-0828-4013-9a52-9cca27ed9df8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:50.995181 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-88bed2ba-0828-4013-9a52-9cca27ed9df8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:50.995986 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-88bed2ba-0828-4013-9a52-9cca27ed9df8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:50.996428 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-88bed2ba-0828-4013-9a52-9cca27ed9df8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:51.097989 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7d37194f-59e5-4ee9-9bfc-0247be7fa19a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:51.099002 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7d37194f-59e5-4ee9-9bfc-0247be7fa19a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:51.110803 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7d37194f-59e5-4ee9-9bfc-0247be7fa19a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:51.111258 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7d37194f-59e5-4ee9-9bfc-0247be7fa19a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:51.112265 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7d37194f-59e5-4ee9-9bfc-0247be7fa19a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:51.112885 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7d37194f-59e5-4ee9-9bfc-0247be7fa19a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:51.182307 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7d37194f-59e5-4ee9-9bfc-0247be7fa19a tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088112 Jan 10 11:39:51.183575 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 214/425] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:39:51 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:39:51.287697 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-88bed2ba-0828-4013-9a52-9cca27ed9df8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:51.301860 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-88bed2ba-0828-4013-9a52-9cca27ed9df8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.331833 Jan 10 11:39:51.303018 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 212/426] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:50 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:51.589565 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7a263a78-585a-4903-ba43-f9d8b436a77a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:51.590429 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7a263a78-585a-4903-ba43-f9d8b436a77a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:51.599184 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7a263a78-585a-4903-ba43-f9d8b436a77a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:51.599956 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7a263a78-585a-4903-ba43-f9d8b436a77a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:51.601219 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7a263a78-585a-4903-ba43-f9d8b436a77a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:51.602800 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7a263a78-585a-4903-ba43-f9d8b436a77a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:51.970124 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7a263a78-585a-4903-ba43-f9d8b436a77a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:51.979358 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7a263a78-585a-4903-ba43-f9d8b436a77a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:51.981479 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7a263a78-585a-4903-ba43-f9d8b436a77a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:51.983551 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7a263a78-585a-4903-ba43-f9d8b436a77a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.399130 Jan 10 11:39:51.985107 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 215/427] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:51 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:39:52.194165 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-87d7d8f3-b7e3-431b-9adc-f2add58ecb9f tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:52.195141 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-87d7d8f3-b7e3-431b-9adc-f2add58ecb9f tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:52.212494 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-87d7d8f3-b7e3-431b-9adc-f2add58ecb9f tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:52.213931 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-87d7d8f3-b7e3-431b-9adc-f2add58ecb9f tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:52.214768 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-87d7d8f3-b7e3-431b-9adc-f2add58ecb9f tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:52.215476 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-87d7d8f3-b7e3-431b-9adc-f2add58ecb9f tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:52.262036 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-87d7d8f3-b7e3-431b-9adc-f2add58ecb9f tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071689 Jan 10 11:39:52.262733 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 213/428] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:39:52 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:39:52.320686 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ef10814d-8076-4f3f-8752-6c3de1752ce7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:52.321514 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ef10814d-8076-4f3f-8752-6c3de1752ce7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:52.327841 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ef10814d-8076-4f3f-8752-6c3de1752ce7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:52.328299 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ef10814d-8076-4f3f-8752-6c3de1752ce7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:52.329255 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ef10814d-8076-4f3f-8752-6c3de1752ce7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:52.329701 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ef10814d-8076-4f3f-8752-6c3de1752ce7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:52.737541 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ef10814d-8076-4f3f-8752-6c3de1752ce7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:52.746910 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ef10814d-8076-4f3f-8752-6c3de1752ce7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.430969 Jan 10 11:39:52.748080 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 216/429] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:52 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:53.004777 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-791adb1e-94d8-41ae-b3cc-955a91cd8c10 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:53.005386 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-791adb1e-94d8-41ae-b3cc-955a91cd8c10 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:53.012207 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-791adb1e-94d8-41ae-b3cc-955a91cd8c10 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:53.012655 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-791adb1e-94d8-41ae-b3cc-955a91cd8c10 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:53.013623 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-791adb1e-94d8-41ae-b3cc-955a91cd8c10 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:53.014228 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-791adb1e-94d8-41ae-b3cc-955a91cd8c10 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:53.256026 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-791adb1e-94d8-41ae-b3cc-955a91cd8c10 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:53.267881 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-791adb1e-94d8-41ae-b3cc-955a91cd8c10 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:53.268609 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-791adb1e-94d8-41ae-b3cc-955a91cd8c10 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:53.272967 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-791adb1e-94d8-41ae-b3cc-955a91cd8c10 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.270964 Jan 10 11:39:53.278966 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-91b38fb7-34ef-4fcd-ad3b-e5b68e8d8cf5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:53.280341 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-91b38fb7-34ef-4fcd-ad3b-e5b68e8d8cf5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:53.284713 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 214/430] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:52 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:39:53.288663 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-91b38fb7-34ef-4fcd-ad3b-e5b68e8d8cf5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:53.289767 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-91b38fb7-34ef-4fcd-ad3b-e5b68e8d8cf5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:53.290776 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-91b38fb7-34ef-4fcd-ad3b-e5b68e8d8cf5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:53.293908 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-91b38fb7-34ef-4fcd-ad3b-e5b68e8d8cf5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:53.323492 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-91b38fb7-34ef-4fcd-ad3b-e5b68e8d8cf5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048833 Jan 10 11:39:53.327957 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 217/431] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:39:53 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:39:53.773397 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-01f73dc5-265b-4775-97b3-c22ba94a6809 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:53.773397 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-01f73dc5-265b-4775-97b3-c22ba94a6809 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:53.780165 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-01f73dc5-265b-4775-97b3-c22ba94a6809 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:53.780630 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-01f73dc5-265b-4775-97b3-c22ba94a6809 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:53.781442 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-01f73dc5-265b-4775-97b3-c22ba94a6809 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:53.781880 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-01f73dc5-265b-4775-97b3-c22ba94a6809 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:53.854178 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-cdfd8bd6-f085-4466-8245-00e5bc0c7a6c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:53.884000 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cdfd8bd6-f085-4466-8245-00e5bc0c7a6c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:53.885050 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cdfd8bd6-f085-4466-8245-00e5bc0c7a6c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:54.039149 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-cdfd8bd6-f085-4466-8245-00e5bc0c7a6c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Going to try to stop instance {{(pid=128718) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 10 11:39:54.229638 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-01f73dc5-265b-4775-97b3-c22ba94a6809 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:54.246468 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-01f73dc5-265b-4775-97b3-c22ba94a6809 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.484527 Jan 10 11:39:54.248085 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 215/432] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:53 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:54.291129 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-11084b4d-7d75-41cd-95fd-0c4ae6fc09df tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:54.291930 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-11084b4d-7d75-41cd-95fd-0c4ae6fc09df tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:54.298583 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-11084b4d-7d75-41cd-95fd-0c4ae6fc09df tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:54.299154 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-11084b4d-7d75-41cd-95fd-0c4ae6fc09df tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:54.301246 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-11084b4d-7d75-41cd-95fd-0c4ae6fc09df tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:54.301246 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-11084b4d-7d75-41cd-95fd-0c4ae6fc09df tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:54.459684 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-11084b4d-7d75-41cd-95fd-0c4ae6fc09df tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:54.469791 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-cdfd8bd6-f085-4466-8245-00e5bc0c7a6c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 202 len: 0 microversion: 2.1 time: 0.613467 Jan 10 11:39:54.469791 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 218/433] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:39:53 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:39:54.476136 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2f9d8882-e8c9-4c5d-933d-9cc5bb79ddc8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:54.477463 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2f9d8882-e8c9-4c5d-933d-9cc5bb79ddc8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:54.494571 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-11084b4d-7d75-41cd-95fd-0c4ae6fc09df tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:54.500042 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-11084b4d-7d75-41cd-95fd-0c4ae6fc09df tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:54.504492 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-11084b4d-7d75-41cd-95fd-0c4ae6fc09df tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.217818 Jan 10 11:39:54.518552 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2f9d8882-e8c9-4c5d-933d-9cc5bb79ddc8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:54.518552 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2f9d8882-e8c9-4c5d-933d-9cc5bb79ddc8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:54.518552 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2f9d8882-e8c9-4c5d-933d-9cc5bb79ddc8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:54.518552 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2f9d8882-e8c9-4c5d-933d-9cc5bb79ddc8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:54.521322 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 216/434] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:54 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:39:54.545417 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2f9d8882-e8c9-4c5d-933d-9cc5bb79ddc8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073975 Jan 10 11:39:54.546094 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 219/435] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:39:54 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:39:54.551226 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b82afc4f-4986-48b9-838a-ac559b2207ca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:54.555902 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b82afc4f-4986-48b9-838a-ac559b2207ca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:54.569436 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b82afc4f-4986-48b9-838a-ac559b2207ca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:54.571164 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b82afc4f-4986-48b9-838a-ac559b2207ca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:54.574241 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b82afc4f-4986-48b9-838a-ac559b2207ca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:54.575537 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b82afc4f-4986-48b9-838a-ac559b2207ca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:54.782494 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-b82afc4f-4986-48b9-838a-ac559b2207ca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:54.790703 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f4da04b7-f072-46ca-80ec-75970114288b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-431260641", "imageRef": "b6e63192-9c33-4d80-9555-6de2bb10fd32", "flavorRef": "452", "networks": [{"uuid": "73452465-d5d7-4c27-928c-80c648c05035"}]}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:54.792021 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b82afc4f-4986-48b9-838a-ac559b2207ca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1722 microversion: 2.1 time: 0.269333 Jan 10 11:39:54.794729 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 217/436] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:54 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:54.866632 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.network.neutron [None req-f4da04b7-f072-46ca-80ec-75970114288b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] validate_networks() for [('73452465-d5d7-4c27-928c-80c648c05035', None, None, None, None, None)] {{(pid=128718) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:39:55.265907 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a2880c4d-c1f2-4f19-9e08-2859a8de64db tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:55.268172 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a2880c4d-c1f2-4f19-9e08-2859a8de64db tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:55.282806 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a2880c4d-c1f2-4f19-9e08-2859a8de64db tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:55.283264 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a2880c4d-c1f2-4f19-9e08-2859a8de64db tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:55.284324 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a2880c4d-c1f2-4f19-9e08-2859a8de64db tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:55.284938 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a2880c4d-c1f2-4f19-9e08-2859a8de64db tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:55.579338 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a2880c4d-c1f2-4f19-9e08-2859a8de64db tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:55.582428 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-f4da04b7-f072-46ca-80ec-75970114288b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Flavor limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:39:55.582861 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-f4da04b7-f072-46ca-80ec-75970114288b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Image limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:39:55.583666 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-f4da04b7-f072-46ca-80ec-75970114288b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Flavor pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:39:55.584110 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-f4da04b7-f072-46ca-80ec-75970114288b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Image pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:39:55.584556 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-f4da04b7-f072-46ca-80ec-75970114288b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:39:55.596336 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a2880c4d-c1f2-4f19-9e08-2859a8de64db tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.334578 Jan 10 11:39:55.625549 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f4da04b7-f072-46ca-80ec-75970114288b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:55.626203 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f4da04b7-f072-46ca-80ec-75970114288b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:55.628079 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f4da04b7-f072-46ca-80ec-75970114288b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:55.628720 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f4da04b7-f072-46ca-80ec-75970114288b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:55.628950 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 218/437] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:55 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:55.652838 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b57bf3d0-6372-4f43-bce8-2f3924feb63b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:55.654355 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b57bf3d0-6372-4f43-bce8-2f3924feb63b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:55.661257 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b57bf3d0-6372-4f43-bce8-2f3924feb63b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:55.662108 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b57bf3d0-6372-4f43-bce8-2f3924feb63b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:55.663098 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b57bf3d0-6372-4f43-bce8-2f3924feb63b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:55.663759 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b57bf3d0-6372-4f43-bce8-2f3924feb63b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:55.685333 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-f4da04b7-f072-46ca-80ec-75970114288b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Getting quotas for project 1c300abbfb3b48dab6c40f20c7eb9cd1. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:39:55.700731 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-f4da04b7-f072-46ca-80ec-75970114288b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Getting quotas for user b6431c85b6c74608aae42e0e856d1a6d and project 1c300abbfb3b48dab6c40f20c7eb9cd1. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:39:55.732477 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f4da04b7-f072-46ca-80ec-75970114288b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Going to run 1 instances... {{(pid=128718) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:39:55.743573 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f4da04b7-f072-46ca-80ec-75970114288b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e63192-9c33-4d80-9555-6de2bb10fd32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:39:55.900825 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-b57bf3d0-6372-4f43-bce8-2f3924feb63b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:55.910131 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-b57bf3d0-6372-4f43-bce8-2f3924feb63b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:55.912127 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-b57bf3d0-6372-4f43-bce8-2f3924feb63b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:55.913485 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b57bf3d0-6372-4f43-bce8-2f3924feb63b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.278077 Jan 10 11:39:55.914136 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 219/438] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:55 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:39:55.929533 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a7df3fd7-1459-45f5-b9f5-3928e65496ec tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:55.930549 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a7df3fd7-1459-45f5-b9f5-3928e65496ec tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:55.953556 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a7df3fd7-1459-45f5-b9f5-3928e65496ec tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:55.955482 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a7df3fd7-1459-45f5-b9f5-3928e65496ec tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:55.959366 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a7df3fd7-1459-45f5-b9f5-3928e65496ec tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:55.966243 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a7df3fd7-1459-45f5-b9f5-3928e65496ec tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:55.985607 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f4da04b7-f072-46ca-80ec-75970114288b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.198707 Jan 10 11:39:55.992538 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 220/439] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:39:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 11:39:56.005223 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-fd0137c6-54a4-43d5-aaa3-10ba61d18da7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:56.009605 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-fd0137c6-54a4-43d5-aaa3-10ba61d18da7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:56.208351 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-fd0137c6-54a4-43d5-aaa3-10ba61d18da7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:56.216888 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-fd0137c6-54a4-43d5-aaa3-10ba61d18da7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1217 microversion: 2.1 time: 0.221215 Jan 10 11:39:56.218034 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 221/440] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:55 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1217 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:56.407174 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a7df3fd7-1459-45f5-b9f5-3928e65496ec tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:56.418159 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a7df3fd7-1459-45f5-b9f5-3928e65496ec tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1722 microversion: 2.1 time: 0.494047 Jan 10 11:39:56.419629 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 220/441] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:55 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1722 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:56.616751 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-6d73c535-5f97-43e5-8e6e-6d484e5e6bc5 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:56.617758 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-6d73c535-5f97-43e5-8e6e-6d484e5e6bc5 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:56.636900 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6d73c535-5f97-43e5-8e6e-6d484e5e6bc5 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:56.638039 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6d73c535-5f97-43e5-8e6e-6d484e5e6bc5 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:56.640049 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6d73c535-5f97-43e5-8e6e-6d484e5e6bc5 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:56.640795 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6d73c535-5f97-43e5-8e6e-6d484e5e6bc5 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:56.913089 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-6d73c535-5f97-43e5-8e6e-6d484e5e6bc5 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:56.922236 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-6d73c535-5f97-43e5-8e6e-6d484e5e6bc5 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.310197 Jan 10 11:39:56.938292 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 222/442] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:56 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:56.941497 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-4c88187b-eb50-47dd-9a0f-7d05f19373f4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:56.942360 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-4c88187b-eb50-47dd-9a0f-7d05f19373f4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:56.949597 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4c88187b-eb50-47dd-9a0f-7d05f19373f4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:56.950046 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4c88187b-eb50-47dd-9a0f-7d05f19373f4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:56.951211 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4c88187b-eb50-47dd-9a0f-7d05f19373f4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:56.951529 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4c88187b-eb50-47dd-9a0f-7d05f19373f4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:57.137803 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-4c88187b-eb50-47dd-9a0f-7d05f19373f4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:57.145612 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-4c88187b-eb50-47dd-9a0f-7d05f19373f4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:57.147201 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-4c88187b-eb50-47dd-9a0f-7d05f19373f4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:57.148374 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-4c88187b-eb50-47dd-9a0f-7d05f19373f4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1743 microversion: 2.20 time: 0.219892 Jan 10 11:39:57.149538 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 221/443] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:56 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1743 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:39:57.235452 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-57e9f4af-fa1a-417b-87d2-3ffc9ae3544c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:57.236851 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-57e9f4af-fa1a-417b-87d2-3ffc9ae3544c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:57.305406 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-57e9f4af-fa1a-417b-87d2-3ffc9ae3544c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:57.312634 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-57e9f4af-fa1a-417b-87d2-3ffc9ae3544c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1217 microversion: 2.1 time: 0.081550 Jan 10 11:39:57.313331 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 222/444] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:57 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:57.369500 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-1cbd6c19-cd53-43f1-bff0-3e7a04f9c64b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Action: 'create', calling method: .version_select at 0x7f4779c04ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-994919792"}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:57.385767 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-1cbd6c19-cd53-43f1-bff0-3e7a04f9c64b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Getting quotas for project 6940c4980bd247c986a305a72a9d1434. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:39:57.390028 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-1cbd6c19-cd53-43f1-bff0-3e7a04f9c64b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Getting quotas for user 0d9c367e90704768900cf144a1639c27 and project 6940c4980bd247c986a305a72a9d1434. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:39:57.438797 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-53190740-55f9-4673-8222-5f885bb889d0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:57.439562 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-53190740-55f9-4673-8222-5f885bb889d0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:57.447459 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-53190740-55f9-4673-8222-5f885bb889d0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:57.448510 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-53190740-55f9-4673-8222-5f885bb889d0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:57.449329 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-53190740-55f9-4673-8222-5f885bb889d0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:57.449760 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-53190740-55f9-4673-8222-5f885bb889d0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:57.613696 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-53190740-55f9-4673-8222-5f885bb889d0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:57.622265 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-53190740-55f9-4673-8222-5f885bb889d0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1722 microversion: 2.1 time: 0.188601 Jan 10 11:39:57.623303 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 223/445] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:57 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:39:57.647742 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-1cbd6c19-cd53-43f1-bff0-3e7a04f9c64b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Getting quotas for project 6940c4980bd247c986a305a72a9d1434. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:39:57.653121 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-1cbd6c19-cd53-43f1-bff0-3e7a04f9c64b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Getting quotas for user 0d9c367e90704768900cf144a1639c27 and project 6940c4980bd247c986a305a72a9d1434. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:39:57.670243 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-1cbd6c19-cd53-43f1-bff0-3e7a04f9c64b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.499952 Jan 10 11:39:57.671332 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 223/446] 10.222.0.20 () {60 vars in 1157 bytes} [Mon Jan 10 11:39:57 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:57.947379 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-338a85d6-6174-4dae-8753-bb49f7776b52 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:57.948071 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-338a85d6-6174-4dae-8753-bb49f7776b52 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:57.954816 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-338a85d6-6174-4dae-8753-bb49f7776b52 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:57.955506 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-338a85d6-6174-4dae-8753-bb49f7776b52 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:57.956306 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-338a85d6-6174-4dae-8753-bb49f7776b52 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:57.964940 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-338a85d6-6174-4dae-8753-bb49f7776b52 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:58.161248 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-338a85d6-6174-4dae-8753-bb49f7776b52 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:58.171597 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-338a85d6-6174-4dae-8753-bb49f7776b52 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.229005 Jan 10 11:39:58.172205 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 224/447] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:57 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:58.173960 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7b167108-fa1c-461a-8ebd-0e36b3050790 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:58.174632 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7b167108-fa1c-461a-8ebd-0e36b3050790 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:58.182497 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7b167108-fa1c-461a-8ebd-0e36b3050790 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:58.183162 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7b167108-fa1c-461a-8ebd-0e36b3050790 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:58.184038 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7b167108-fa1c-461a-8ebd-0e36b3050790 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:58.184547 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7b167108-fa1c-461a-8ebd-0e36b3050790 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:58.331069 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-75772ca9-6614-4ec9-99c2-77abf3068398 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:58.337742 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-75772ca9-6614-4ec9-99c2-77abf3068398 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:58.343161 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-75772ca9-6614-4ec9-99c2-77abf3068398 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:58.343848 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-75772ca9-6614-4ec9-99c2-77abf3068398 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:58.344692 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-75772ca9-6614-4ec9-99c2-77abf3068398 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:58.347618 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-75772ca9-6614-4ec9-99c2-77abf3068398 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:58.512432 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7b167108-fa1c-461a-8ebd-0e36b3050790 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:58.524040 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7b167108-fa1c-461a-8ebd-0e36b3050790 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:58.527568 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7b167108-fa1c-461a-8ebd-0e36b3050790 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:58.531619 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7b167108-fa1c-461a-8ebd-0e36b3050790 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1743 microversion: 2.20 time: 0.362599 Jan 10 11:39:58.532214 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 224/448] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:58 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1743 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:39:58.554001 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-75772ca9-6614-4ec9-99c2-77abf3068398 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:58.564930 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-75772ca9-6614-4ec9-99c2-77abf3068398 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1213 microversion: 2.1 time: 0.237900 Jan 10 11:39:58.566676 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 225/449] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:58 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1213 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:39:58.643357 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-d14a17a9-52f4-4c84-b389-5762bfd6edf1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:58.645204 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-d14a17a9-52f4-4c84-b389-5762bfd6edf1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:58.656204 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d14a17a9-52f4-4c84-b389-5762bfd6edf1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:58.658294 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d14a17a9-52f4-4c84-b389-5762bfd6edf1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:58.659285 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d14a17a9-52f4-4c84-b389-5762bfd6edf1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:58.659885 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d14a17a9-52f4-4c84-b389-5762bfd6edf1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:58.831034 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-d14a17a9-52f4-4c84-b389-5762bfd6edf1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:58.845144 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-d14a17a9-52f4-4c84-b389-5762bfd6edf1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1722 microversion: 2.1 time: 0.208702 Jan 10 11:39:58.857389 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 225/450] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:58 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:59.190202 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f7a60bbd-976c-4860-877f-7b015722bca0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:59.191272 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f7a60bbd-976c-4860-877f-7b015722bca0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:59.199828 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f7a60bbd-976c-4860-877f-7b015722bca0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:59.200281 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f7a60bbd-976c-4860-877f-7b015722bca0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:59.201111 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f7a60bbd-976c-4860-877f-7b015722bca0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:59.201556 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f7a60bbd-976c-4860-877f-7b015722bca0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:59.536181 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-f7a60bbd-976c-4860-877f-7b015722bca0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:59.547908 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f7a60bbd-976c-4860-877f-7b015722bca0 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.361667 Jan 10 11:39:59.553416 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-82265b9e-ee18-4968-85b8-e62ebeb2bbba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:59.554870 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-82265b9e-ee18-4968-85b8-e62ebeb2bbba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:59.562615 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-82265b9e-ee18-4968-85b8-e62ebeb2bbba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:59.563706 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-82265b9e-ee18-4968-85b8-e62ebeb2bbba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:59.564613 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 226/451] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:59 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:39:59.566020 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-82265b9e-ee18-4968-85b8-e62ebeb2bbba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:59.566723 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-82265b9e-ee18-4968-85b8-e62ebeb2bbba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:59.583962 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-6489fdc1-b11c-4bee-a127-5fef1eb52e83 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:59.584854 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-6489fdc1-b11c-4bee-a127-5fef1eb52e83 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:59.592371 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6489fdc1-b11c-4bee-a127-5fef1eb52e83 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:59.593103 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6489fdc1-b11c-4bee-a127-5fef1eb52e83 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:59.594057 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6489fdc1-b11c-4bee-a127-5fef1eb52e83 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:59.594950 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6489fdc1-b11c-4bee-a127-5fef1eb52e83 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:59.741842 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-6489fdc1-b11c-4bee-a127-5fef1eb52e83 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:59.741842 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-6489fdc1-b11c-4bee-a127-5fef1eb52e83 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1269 microversion: 2.1 time: 0.098516 Jan 10 11:39:59.741842 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 227/452] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:59 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1269 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:39:59.742666 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-82265b9e-ee18-4968-85b8-e62ebeb2bbba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:59.747811 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-82265b9e-ee18-4968-85b8-e62ebeb2bbba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:59.749456 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-82265b9e-ee18-4968-85b8-e62ebeb2bbba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:39:59.750822 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-82265b9e-ee18-4968-85b8-e62ebeb2bbba tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1743 microversion: 2.20 time: 0.201506 Jan 10 11:39:59.751418 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 226/453] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:39:59 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1743 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:39:59.851105 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-84f4c055-dbe6-4dfb-93c2-ba05b34e382d req-c5f44387-6c73-4892-82fa-db0a66f62277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb58298d-9795-4c2b-86b6-3b17b668765f", "name": "network-vif-plugged", "status": "completed", "tag": "ad9b761f-8e30-4890-b16f-aceb4777ab0b"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:39:59.853115 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:39:59.853115 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:39:59.862581 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-84f4c055-dbe6-4dfb-93c2-ba05b34e382d req-c5f44387-6c73-4892-82fa-db0a66f62277 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:59.863072 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-84f4c055-dbe6-4dfb-93c2-ba05b34e382d req-c5f44387-6c73-4892-82fa-db0a66f62277 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:59.863217 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ee861c71-58e3-489f-af1a-cf526b8a3e05 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:39:59.863900 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ee861c71-58e3-489f-af1a-cf526b8a3e05 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:39:59.870366 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ee861c71-58e3-489f-af1a-cf526b8a3e05 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:59.870989 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ee861c71-58e3-489f-af1a-cf526b8a3e05 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:59.871793 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ee861c71-58e3-489f-af1a-cf526b8a3e05 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:39:59.872244 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ee861c71-58e3-489f-af1a-cf526b8a3e05 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:39:59.876768 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-84f4c055-dbe6-4dfb-93c2-ba05b34e382d req-c5f44387-6c73-4892-82fa-db0a66f62277 service nova] Creating event network-vif-plugged:ad9b761f-8e30-4890-b16f-aceb4777ab0b for instance bb58298d-9795-4c2b-86b6-3b17b668765f on hv-cinder-maste Jan 10 11:39:59.882073 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-84f4c055-dbe6-4dfb-93c2-ba05b34e382d req-c5f44387-6c73-4892-82fa-db0a66f62277 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034700 Jan 10 11:39:59.883505 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 228/454] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:40:00.094095 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ee861c71-58e3-489f-af1a-cf526b8a3e05 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:00.105853 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ee861c71-58e3-489f-af1a-cf526b8a3e05 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1722 microversion: 2.1 time: 0.245878 Jan 10 11:40:00.106200 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 227/455] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:39:59 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:00.596615 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-0ec82418-c2c6-48d5-bc65-67ef8437aa5c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:00.598135 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-0ec82418-c2c6-48d5-bc65-67ef8437aa5c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:00.624399 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0ec82418-c2c6-48d5-bc65-67ef8437aa5c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:00.627681 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0ec82418-c2c6-48d5-bc65-67ef8437aa5c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:00.632055 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0ec82418-c2c6-48d5-bc65-67ef8437aa5c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:00.632810 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0ec82418-c2c6-48d5-bc65-67ef8437aa5c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:00.763194 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b49a9840-b086-498f-841e-22380acd20dc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:00.763194 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b49a9840-b086-498f-841e-22380acd20dc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:00.775013 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b49a9840-b086-498f-841e-22380acd20dc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:00.775748 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b49a9840-b086-498f-841e-22380acd20dc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:00.776881 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b49a9840-b086-498f-841e-22380acd20dc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:00.777534 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b49a9840-b086-498f-841e-22380acd20dc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:00.939822 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b49a9840-b086-498f-841e-22380acd20dc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:00.951820 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b49a9840-b086-498f-841e-22380acd20dc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1287 microversion: 2.1 time: 0.208235 Jan 10 11:40:00.955935 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 228/456] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:00 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1287 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:00.981353 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-824eb99f-921d-4488-b2e5-955d1951a1eb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:00.982798 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-824eb99f-921d-4488-b2e5-955d1951a1eb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:00.995036 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-824eb99f-921d-4488-b2e5-955d1951a1eb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:01.000660 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-824eb99f-921d-4488-b2e5-955d1951a1eb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:01.006390 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-824eb99f-921d-4488-b2e5-955d1951a1eb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:01.007239 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-824eb99f-921d-4488-b2e5-955d1951a1eb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:01.218553 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-0ec82418-c2c6-48d5-bc65-67ef8437aa5c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:01.236295 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-0ec82418-c2c6-48d5-bc65-67ef8437aa5c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.656244 Jan 10 11:40:01.244609 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 229/457] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:00 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:01.262046 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-54901a5e-e1ec-4245-9014-281804582fa6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:01.266644 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-54901a5e-e1ec-4245-9014-281804582fa6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:01.275224 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-54901a5e-e1ec-4245-9014-281804582fa6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:01.276187 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-54901a5e-e1ec-4245-9014-281804582fa6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:01.278098 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-54901a5e-e1ec-4245-9014-281804582fa6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:01.278813 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-54901a5e-e1ec-4245-9014-281804582fa6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:01.431246 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-824eb99f-921d-4488-b2e5-955d1951a1eb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:01.444536 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-824eb99f-921d-4488-b2e5-955d1951a1eb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:01.447071 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-824eb99f-921d-4488-b2e5-955d1951a1eb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:01.448917 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-824eb99f-921d-4488-b2e5-955d1951a1eb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1738 microversion: 2.20 time: 0.491639 Jan 10 11:40:01.450551 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 229/458] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:00 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1738 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:01.611659 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-54901a5e-e1ec-4245-9014-281804582fa6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:01.624276 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-54901a5e-e1ec-4245-9014-281804582fa6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1722 microversion: 2.1 time: 0.377629 Jan 10 11:40:01.626486 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 230/459] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:01 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1722 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:01.973485 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-577107b9-310b-4cd6-a903-5d4745bd8f02 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:01.975890 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-577107b9-310b-4cd6-a903-5d4745bd8f02 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:01.987818 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-577107b9-310b-4cd6-a903-5d4745bd8f02 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:01.988682 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-577107b9-310b-4cd6-a903-5d4745bd8f02 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:01.989743 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-577107b9-310b-4cd6-a903-5d4745bd8f02 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:01.990476 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-577107b9-310b-4cd6-a903-5d4745bd8f02 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:02.245465 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-577107b9-310b-4cd6-a903-5d4745bd8f02 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:02.250943 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-577107b9-310b-4cd6-a903-5d4745bd8f02 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1317 microversion: 2.1 time: 0.281689 Jan 10 11:40:02.251877 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 230/460] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:01 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:02.264905 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-1506c767-3ae5-42d2-b45a-766cfcbb8795 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:02.265798 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-1506c767-3ae5-42d2-b45a-766cfcbb8795 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:02.277219 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1506c767-3ae5-42d2-b45a-766cfcbb8795 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:02.277680 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1506c767-3ae5-42d2-b45a-766cfcbb8795 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:02.278800 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1506c767-3ae5-42d2-b45a-766cfcbb8795 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:02.279545 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1506c767-3ae5-42d2-b45a-766cfcbb8795 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:02.471029 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-fc8103c6-0ffd-49e6-97ad-d418530750fe tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:02.472433 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-fc8103c6-0ffd-49e6-97ad-d418530750fe tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:02.500119 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fc8103c6-0ffd-49e6-97ad-d418530750fe tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:02.500872 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fc8103c6-0ffd-49e6-97ad-d418530750fe tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:02.501873 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fc8103c6-0ffd-49e6-97ad-d418530750fe tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:02.502341 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fc8103c6-0ffd-49e6-97ad-d418530750fe tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:02.739534 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-1506c767-3ae5-42d2-b45a-766cfcbb8795 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:02.751549 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-1506c767-3ae5-42d2-b45a-766cfcbb8795 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.496136 Jan 10 11:40:02.767990 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 231/461] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:02 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:02.779656 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ca5e9daa-15e9-438d-83be-b288a646b1fc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:02.782060 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ca5e9daa-15e9-438d-83be-b288a646b1fc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:02.790478 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ca5e9daa-15e9-438d-83be-b288a646b1fc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:02.791367 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ca5e9daa-15e9-438d-83be-b288a646b1fc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:02.792357 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ca5e9daa-15e9-438d-83be-b288a646b1fc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:02.793478 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ca5e9daa-15e9-438d-83be-b288a646b1fc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:02.894192 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-fc8103c6-0ffd-49e6-97ad-d418530750fe tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:02.903725 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-fc8103c6-0ffd-49e6-97ad-d418530750fe tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:02.905240 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-fc8103c6-0ffd-49e6-97ad-d418530750fe tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:02.906450 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-fc8103c6-0ffd-49e6-97ad-d418530750fe tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1738 microversion: 2.20 time: 0.440283 Jan 10 11:40:02.907016 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 231/462] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:02 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1738 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:40:03.021987 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ca5e9daa-15e9-438d-83be-b288a646b1fc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:03.044214 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ca5e9daa-15e9-438d-83be-b288a646b1fc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1722 microversion: 2.1 time: 0.275038 Jan 10 11:40:03.045779 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 232/463] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:02 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:03.270911 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3cead866-be10-4dd2-bf0f-3e80d55abd46 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:03.272163 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3cead866-be10-4dd2-bf0f-3e80d55abd46 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:03.284875 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3cead866-be10-4dd2-bf0f-3e80d55abd46 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:03.285110 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3cead866-be10-4dd2-bf0f-3e80d55abd46 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:03.286120 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3cead866-be10-4dd2-bf0f-3e80d55abd46 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:03.286802 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3cead866-be10-4dd2-bf0f-3e80d55abd46 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:03.492053 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3cead866-be10-4dd2-bf0f-3e80d55abd46 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:03.501815 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3cead866-be10-4dd2-bf0f-3e80d55abd46 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1317 microversion: 2.1 time: 0.235146 Jan 10 11:40:03.502756 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 232/464] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:03 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:03.537525 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-d608879e-8da8-4463-8baf-c6b900e1d721 req-4935c4af-a2a9-4948-bb5f-23626308f082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffb3777f-32fa-4f8b-8eaf-277e990c233a", "tag": "f7b09e29-560e-4123-8100-b592a8c30f4f"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:40:03.539796 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:40:03.539796 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:40:03.557142 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-d608879e-8da8-4463-8baf-c6b900e1d721 req-4935c4af-a2a9-4948-bb5f-23626308f082 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:03.557769 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-d608879e-8da8-4463-8baf-c6b900e1d721 req-4935c4af-a2a9-4948-bb5f-23626308f082 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:03.581896 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-d608879e-8da8-4463-8baf-c6b900e1d721 req-4935c4af-a2a9-4948-bb5f-23626308f082 service nova] Creating event network-changed:f7b09e29-560e-4123-8100-b592a8c30f4f for instance ffb3777f-32fa-4f8b-8eaf-277e990c233a on hv-cinder-maste Jan 10 11:40:03.590024 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-d608879e-8da8-4463-8baf-c6b900e1d721 req-4935c4af-a2a9-4948-bb5f-23626308f082 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057786 Jan 10 11:40:03.591420 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 233/465] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:40:03.769800 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-d66517db-9caf-4208-ab6b-0d33a3e26866 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:03.770625 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-d66517db-9caf-4208-ab6b-0d33a3e26866 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:03.786820 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d66517db-9caf-4208-ab6b-0d33a3e26866 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:03.787683 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d66517db-9caf-4208-ab6b-0d33a3e26866 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:03.795501 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d66517db-9caf-4208-ab6b-0d33a3e26866 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:03.795501 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d66517db-9caf-4208-ab6b-0d33a3e26866 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:03.933360 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-636db5a3-7f0e-45b7-9ec5-62ea0df3de22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:03.933360 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-636db5a3-7f0e-45b7-9ec5-62ea0df3de22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:03.948570 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-636db5a3-7f0e-45b7-9ec5-62ea0df3de22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:03.951401 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-636db5a3-7f0e-45b7-9ec5-62ea0df3de22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:03.953827 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-636db5a3-7f0e-45b7-9ec5-62ea0df3de22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:03.955309 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-636db5a3-7f0e-45b7-9ec5-62ea0df3de22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:04.457970 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-d66517db-9caf-4208-ab6b-0d33a3e26866 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:04.469356 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-d66517db-9caf-4208-ab6b-0d33a3e26866 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1568 microversion: 2.1 time: 0.703791 Jan 10 11:40:04.480862 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 233/466] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:03 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1568 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:04.486460 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-21d5113b-c143-4e9f-97ba-99a7138ab448 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:04.487373 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-21d5113b-c143-4e9f-97ba-99a7138ab448 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:04.496386 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-21d5113b-c143-4e9f-97ba-99a7138ab448 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:04.497180 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-21d5113b-c143-4e9f-97ba-99a7138ab448 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:04.498509 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-21d5113b-c143-4e9f-97ba-99a7138ab448 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:04.499157 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-21d5113b-c143-4e9f-97ba-99a7138ab448 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:04.592598 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-636db5a3-7f0e-45b7-9ec5-62ea0df3de22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:04.612683 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-636db5a3-7f0e-45b7-9ec5-62ea0df3de22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:04.622028 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-636db5a3-7f0e-45b7-9ec5-62ea0df3de22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:04.627331 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-636db5a3-7f0e-45b7-9ec5-62ea0df3de22 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1738 microversion: 2.20 time: 0.700291 Jan 10 11:40:04.631641 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 234/467] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:03 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1738 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:04.640434 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a80ab311-4a62-4f76-ae01-28f11d916028 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:04.641098 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a80ab311-4a62-4f76-ae01-28f11d916028 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:04.679423 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a80ab311-4a62-4f76-ae01-28f11d916028 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:04.680996 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a80ab311-4a62-4f76-ae01-28f11d916028 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:04.682465 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a80ab311-4a62-4f76-ae01-28f11d916028 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:04.683172 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a80ab311-4a62-4f76-ae01-28f11d916028 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:04.889078 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-21d5113b-c143-4e9f-97ba-99a7138ab448 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:04.906622 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-21d5113b-c143-4e9f-97ba-99a7138ab448 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1722 microversion: 2.1 time: 0.423710 Jan 10 11:40:04.925772 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 234/468] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:04 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1722 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:04.978605 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a80ab311-4a62-4f76-ae01-28f11d916028 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:04.988939 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a80ab311-4a62-4f76-ae01-28f11d916028 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1317 microversion: 2.1 time: 0.356156 Jan 10 11:40:04.989618 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 235/469] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:04 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:05.487282 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8484974f-132f-4a4d-841b-5c9cb719215c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:05.488541 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-8484974f-132f-4a4d-841b-5c9cb719215c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:05.496639 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8484974f-132f-4a4d-841b-5c9cb719215c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:05.497495 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8484974f-132f-4a4d-841b-5c9cb719215c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:05.498757 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8484974f-132f-4a4d-841b-5c9cb719215c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:05.499450 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8484974f-132f-4a4d-841b-5c9cb719215c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:05.646633 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-aae95b6d-3800-405d-845c-cb6c2b3f4763 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:05.647550 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-aae95b6d-3800-405d-845c-cb6c2b3f4763 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:05.655494 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-aae95b6d-3800-405d-845c-cb6c2b3f4763 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:05.659273 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-aae95b6d-3800-405d-845c-cb6c2b3f4763 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:05.660134 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-aae95b6d-3800-405d-845c-cb6c2b3f4763 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:05.660581 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-aae95b6d-3800-405d-845c-cb6c2b3f4763 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:05.704868 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-8484974f-132f-4a4d-841b-5c9cb719215c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:05.732457 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-8484974f-132f-4a4d-841b-5c9cb719215c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1548 microversion: 2.1 time: 0.248415 Jan 10 11:40:05.744772 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 235/470] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:05 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1548 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:05.793758 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3cc9eb15-488a-4057-a5fb-83a210c65a3c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:05.797306 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3cc9eb15-488a-4057-a5fb-83a210c65a3c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:05.812893 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3cc9eb15-488a-4057-a5fb-83a210c65a3c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:05.815231 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3cc9eb15-488a-4057-a5fb-83a210c65a3c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:05.818787 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3cc9eb15-488a-4057-a5fb-83a210c65a3c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:05.821306 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3cc9eb15-488a-4057-a5fb-83a210c65a3c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:05.873336 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-aae95b6d-3800-405d-845c-cb6c2b3f4763 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:05.891250 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-aae95b6d-3800-405d-845c-cb6c2b3f4763 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:05.892816 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-aae95b6d-3800-405d-845c-cb6c2b3f4763 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:05.894358 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-aae95b6d-3800-405d-845c-cb6c2b3f4763 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1738 microversion: 2.20 time: 0.251439 Jan 10 11:40:05.906512 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 236/471] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:05 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:40:05.938572 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7c1bd92a-764b-4601-8dae-fd585afd1627 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:05.938572 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7c1bd92a-764b-4601-8dae-fd585afd1627 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:05.944817 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7c1bd92a-764b-4601-8dae-fd585afd1627 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:05.950934 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7c1bd92a-764b-4601-8dae-fd585afd1627 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:05.952099 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7c1bd92a-764b-4601-8dae-fd585afd1627 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:05.952550 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7c1bd92a-764b-4601-8dae-fd585afd1627 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:06.150870 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-3cc9eb15-488a-4057-a5fb-83a210c65a3c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] HTTP exception thrown: Cannot 'detach_volume' instance 9bb75a87-2b05-43d3-b570-a04858874b50 while it is in vm_state rescued Jan 10 11:40:06.154150 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3cc9eb15-488a-4057-a5fb-83a210c65a3c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Returning 409 to user: Cannot 'detach_volume' instance 9bb75a87-2b05-43d3-b570-a04858874b50 while it is in vm_state rescued {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:40:06.158304 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3cc9eb15-488a-4057-a5fb-83a210c65a3c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/os-volume_attachments/2097ecd5-5982-4ba9-b10f-dc5138579eb5" status: 409 len: 152 microversion: 2.1 time: 0.401129 Jan 10 11:40:06.158304 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 236/472] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jan 10 11:40:05 2022] DELETE /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/os-volume_attachments/2097ecd5-5982-4ba9-b10f-dc5138579eb5 => generated 152 bytes in 402 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 10 11:40:06.165406 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-7c1bd92a-764b-4601-8dae-fd585afd1627 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:06.173361 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-44edea20-55d0-4c1a-b9ee-afe4b20c88c2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:06.176038 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-44edea20-55d0-4c1a-b9ee-afe4b20c88c2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:06.187742 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-44edea20-55d0-4c1a-b9ee-afe4b20c88c2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:06.205911 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-44edea20-55d0-4c1a-b9ee-afe4b20c88c2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:06.205911 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-44edea20-55d0-4c1a-b9ee-afe4b20c88c2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:06.205911 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-44edea20-55d0-4c1a-b9ee-afe4b20c88c2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:06.206621 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7c1bd92a-764b-4601-8dae-fd585afd1627 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1722 microversion: 2.1 time: 0.260656 Jan 10 11:40:06.206621 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 237/473] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:05 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:06.210882 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-95aefb9f-4e82-43f4-81a8-80960d842e46 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:40:06.212383 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-95aefb9f-4e82-43f4-81a8-80960d842e46 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:06.224388 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-95aefb9f-4e82-43f4-81a8-80960d842e46 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:06.225555 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-95aefb9f-4e82-43f4-81a8-80960d842e46 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:06.229132 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-95aefb9f-4e82-43f4-81a8-80960d842e46 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:06.233161 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-95aefb9f-4e82-43f4-81a8-80960d842e46 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:06.392559 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-44edea20-55d0-4c1a-b9ee-afe4b20c88c2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:06.401958 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-44edea20-55d0-4c1a-b9ee-afe4b20c88c2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1317 microversion: 2.1 time: 0.238563 Jan 10 11:40:06.411334 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 237/474] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:06 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:06.755475 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-95aefb9f-4e82-43f4-81a8-80960d842e46 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "POST /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/action" status: 202 len: 0 microversion: 2.1 time: 0.559755 Jan 10 11:40:06.756970 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 238/475] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:40:06 2022] POST /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:40:06.802691 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3b419834-7d52-4917-999c-f41a0ebe4f23 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:06.802691 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3b419834-7d52-4917-999c-f41a0ebe4f23 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:06.865743 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3b419834-7d52-4917-999c-f41a0ebe4f23 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:06.866234 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3b419834-7d52-4917-999c-f41a0ebe4f23 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:06.867337 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3b419834-7d52-4917-999c-f41a0ebe4f23 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:06.867999 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3b419834-7d52-4917-999c-f41a0ebe4f23 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:06.914411 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-97d9ae31-6c94-4612-a6a8-63586e894402 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:06.916796 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-97d9ae31-6c94-4612-a6a8-63586e894402 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:06.926419 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-97d9ae31-6c94-4612-a6a8-63586e894402 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:06.932863 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-97d9ae31-6c94-4612-a6a8-63586e894402 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:06.934609 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-97d9ae31-6c94-4612-a6a8-63586e894402 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:06.935261 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-97d9ae31-6c94-4612-a6a8-63586e894402 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:07.154402 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3b419834-7d52-4917-999c-f41a0ebe4f23 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:07.164150 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3b419834-7d52-4917-999c-f41a0ebe4f23 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1556 microversion: 2.1 time: 0.396136 Jan 10 11:40:07.164906 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 238/476] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:06 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1556 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:07.170369 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-97d9ae31-6c94-4612-a6a8-63586e894402 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:07.181631 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-97d9ae31-6c94-4612-a6a8-63586e894402 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:07.183186 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-97d9ae31-6c94-4612-a6a8-63586e894402 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:07.184468 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-97d9ae31-6c94-4612-a6a8-63586e894402 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1738 microversion: 2.20 time: 0.274101 Jan 10 11:40:07.185033 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 239/477] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:06 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1738 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:07.213201 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-fb6edb57-2cd5-44c0-96b1-4cde14a6cee5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:07.214574 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-fb6edb57-2cd5-44c0-96b1-4cde14a6cee5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:07.221650 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fb6edb57-2cd5-44c0-96b1-4cde14a6cee5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:07.222110 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fb6edb57-2cd5-44c0-96b1-4cde14a6cee5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:07.222950 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fb6edb57-2cd5-44c0-96b1-4cde14a6cee5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:07.223395 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fb6edb57-2cd5-44c0-96b1-4cde14a6cee5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:07.425040 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-fb6edb57-2cd5-44c0-96b1-4cde14a6cee5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:07.433593 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-58180376-8e48-4f7d-8339-d4e4e98a33a8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:07.434282 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-58180376-8e48-4f7d-8339-d4e4e98a33a8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:07.436898 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-fb6edb57-2cd5-44c0-96b1-4cde14a6cee5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1722 microversion: 2.1 time: 0.227409 Jan 10 11:40:07.437992 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 239/478] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:07 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:07.446313 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-58180376-8e48-4f7d-8339-d4e4e98a33a8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:07.446964 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-58180376-8e48-4f7d-8339-d4e4e98a33a8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:07.448097 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-58180376-8e48-4f7d-8339-d4e4e98a33a8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:07.448624 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-58180376-8e48-4f7d-8339-d4e4e98a33a8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:07.630372 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-58180376-8e48-4f7d-8339-d4e4e98a33a8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:07.640859 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-58180376-8e48-4f7d-8339-d4e4e98a33a8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1317 microversion: 2.1 time: 0.224652 Jan 10 11:40:07.641610 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 240/479] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:07 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:08.184053 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-9cbd31ad-acf3-4385-8b8a-920b865c48d3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:08.184683 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-9cbd31ad-acf3-4385-8b8a-920b865c48d3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:08.190803 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9cbd31ad-acf3-4385-8b8a-920b865c48d3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:08.191656 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9cbd31ad-acf3-4385-8b8a-920b865c48d3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:08.192583 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9cbd31ad-acf3-4385-8b8a-920b865c48d3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:08.193084 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9cbd31ad-acf3-4385-8b8a-920b865c48d3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:08.205146 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5679a219-5efa-440a-8682-a524e42c6865 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:08.205765 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5679a219-5efa-440a-8682-a524e42c6865 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:08.226489 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5679a219-5efa-440a-8682-a524e42c6865 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:08.227751 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5679a219-5efa-440a-8682-a524e42c6865 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:08.229451 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5679a219-5efa-440a-8682-a524e42c6865 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:08.230490 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5679a219-5efa-440a-8682-a524e42c6865 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:08.493280 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-9cbd31ad-acf3-4385-8b8a-920b865c48d3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:08.511460 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-9cbd31ad-acf3-4385-8b8a-920b865c48d3 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1556 microversion: 2.1 time: 0.328823 Jan 10 11:40:08.511460 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 240/480] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:08 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1556 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:08.514504 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ff74e6dc-9a5c-45e1-a232-f871be11029f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:08.515109 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ff74e6dc-9a5c-45e1-a232-f871be11029f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:08.548297 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5679a219-5efa-440a-8682-a524e42c6865 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:08.561844 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ff74e6dc-9a5c-45e1-a232-f871be11029f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:08.562611 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ff74e6dc-9a5c-45e1-a232-f871be11029f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:08.563631 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ff74e6dc-9a5c-45e1-a232-f871be11029f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:08.564262 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ff74e6dc-9a5c-45e1-a232-f871be11029f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:08.580075 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5679a219-5efa-440a-8682-a524e42c6865 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:08.583358 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5679a219-5efa-440a-8682-a524e42c6865 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:08.588810 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5679a219-5efa-440a-8682-a524e42c6865 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1738 microversion: 2.20 time: 0.385802 Jan 10 11:40:08.589972 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 241/481] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:08 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1738 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:40:08.679788 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-4015d75d-e467-4baf-aafb-cf038934f659 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:08.682769 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-4015d75d-e467-4baf-aafb-cf038934f659 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:08.709639 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4015d75d-e467-4baf-aafb-cf038934f659 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:08.710205 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4015d75d-e467-4baf-aafb-cf038934f659 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:08.712660 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4015d75d-e467-4baf-aafb-cf038934f659 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:08.713368 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4015d75d-e467-4baf-aafb-cf038934f659 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:08.926081 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ff74e6dc-9a5c-45e1-a232-f871be11029f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:08.943181 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ff74e6dc-9a5c-45e1-a232-f871be11029f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1722 microversion: 2.1 time: 0.428087 Jan 10 11:40:08.945076 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 241/482] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:08 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1722 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:09.014435 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-4015d75d-e467-4baf-aafb-cf038934f659 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:09.023262 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-4015d75d-e467-4baf-aafb-cf038934f659 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1317 microversion: 2.1 time: 0.367484 Jan 10 11:40:09.032984 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 242/483] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:08 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:09.537318 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-25f35e16-2d14-477e-b198-32e3b3584add tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:09.538994 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-25f35e16-2d14-477e-b198-32e3b3584add tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:09.550236 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-25f35e16-2d14-477e-b198-32e3b3584add tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:09.550787 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-25f35e16-2d14-477e-b198-32e3b3584add tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:09.551586 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-25f35e16-2d14-477e-b198-32e3b3584add tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:09.552021 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-25f35e16-2d14-477e-b198-32e3b3584add tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:09.610962 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-545b059e-3208-45ae-a61d-35cd0c6269f0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:09.612549 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-545b059e-3208-45ae-a61d-35cd0c6269f0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:09.635515 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-545b059e-3208-45ae-a61d-35cd0c6269f0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:09.636899 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-545b059e-3208-45ae-a61d-35cd0c6269f0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:09.644769 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-545b059e-3208-45ae-a61d-35cd0c6269f0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:09.646103 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-545b059e-3208-45ae-a61d-35cd0c6269f0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:09.880187 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-25f35e16-2d14-477e-b198-32e3b3584add tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:09.894472 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-25f35e16-2d14-477e-b198-32e3b3584add tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1556 microversion: 2.1 time: 0.363482 Jan 10 11:40:09.896158 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 242/484] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:09 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1556 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:09.972424 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-1a87bff0-9616-4675-a9b8-832d8c8ddcf1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:09.973193 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-1a87bff0-9616-4675-a9b8-832d8c8ddcf1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:09.979085 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-545b059e-3208-45ae-a61d-35cd0c6269f0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:09.979827 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1a87bff0-9616-4675-a9b8-832d8c8ddcf1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:09.980361 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1a87bff0-9616-4675-a9b8-832d8c8ddcf1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:09.981942 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1a87bff0-9616-4675-a9b8-832d8c8ddcf1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:09.988215 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1a87bff0-9616-4675-a9b8-832d8c8ddcf1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:09.989443 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-545b059e-3208-45ae-a61d-35cd0c6269f0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:09.991129 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-545b059e-3208-45ae-a61d-35cd0c6269f0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:09.993772 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-545b059e-3208-45ae-a61d-35cd0c6269f0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1738 microversion: 2.20 time: 0.388047 Jan 10 11:40:10.007976 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 243/485] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:09 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1738 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:40:10.045356 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ea8963a6-9579-47fb-8f22-66356254bd27 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:10.047903 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ea8963a6-9579-47fb-8f22-66356254bd27 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:10.065811 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ea8963a6-9579-47fb-8f22-66356254bd27 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:10.066601 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ea8963a6-9579-47fb-8f22-66356254bd27 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:10.067567 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ea8963a6-9579-47fb-8f22-66356254bd27 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:10.068182 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ea8963a6-9579-47fb-8f22-66356254bd27 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:10.268303 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-1a87bff0-9616-4675-a9b8-832d8c8ddcf1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:10.281395 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-1a87bff0-9616-4675-a9b8-832d8c8ddcf1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1722 microversion: 2.1 time: 0.310075 Jan 10 11:40:10.294359 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 243/486] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:09 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:10.300458 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ea8963a6-9579-47fb-8f22-66356254bd27 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:10.326572 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ea8963a6-9579-47fb-8f22-66356254bd27 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1317 microversion: 2.1 time: 0.288657 Jan 10 11:40:10.327737 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 244/487] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:10 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:10.913749 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-31b305d4-4f54-4a1d-8763-ff24c6db9ada tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:10.915229 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-31b305d4-4f54-4a1d-8763-ff24c6db9ada tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:10.924075 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-31b305d4-4f54-4a1d-8763-ff24c6db9ada tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:10.924639 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-31b305d4-4f54-4a1d-8763-ff24c6db9ada tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:10.925655 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-31b305d4-4f54-4a1d-8763-ff24c6db9ada tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:10.926252 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-31b305d4-4f54-4a1d-8763-ff24c6db9ada tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:11.016697 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d2725eec-6d3c-4801-8e07-38bf3423e0f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:11.018103 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d2725eec-6d3c-4801-8e07-38bf3423e0f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:11.027399 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d2725eec-6d3c-4801-8e07-38bf3423e0f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:11.029481 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d2725eec-6d3c-4801-8e07-38bf3423e0f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:11.032322 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d2725eec-6d3c-4801-8e07-38bf3423e0f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:11.033679 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d2725eec-6d3c-4801-8e07-38bf3423e0f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:11.208298 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-31b305d4-4f54-4a1d-8763-ff24c6db9ada tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:11.251731 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-31b305d4-4f54-4a1d-8763-ff24c6db9ada tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1562 microversion: 2.1 time: 0.342113 Jan 10 11:40:11.252803 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 244/488] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:10 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1562 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:11.298406 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-d2725eec-6d3c-4801-8e07-38bf3423e0f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:11.300274 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-dac39801-6b24-4eca-aa98-496ccc1036b9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:11.300884 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-dac39801-6b24-4eca-aa98-496ccc1036b9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:11.307153 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dac39801-6b24-4eca-aa98-496ccc1036b9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:11.307502 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-d2725eec-6d3c-4801-8e07-38bf3423e0f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:11.307635 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dac39801-6b24-4eca-aa98-496ccc1036b9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:11.308416 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dac39801-6b24-4eca-aa98-496ccc1036b9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:11.308855 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dac39801-6b24-4eca-aa98-496ccc1036b9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:11.309947 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-d2725eec-6d3c-4801-8e07-38bf3423e0f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:11.311247 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d2725eec-6d3c-4801-8e07-38bf3423e0f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1738 microversion: 2.20 time: 0.298334 Jan 10 11:40:11.327895 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 245/489] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:11 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1738 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:40:11.333396 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3c602ebf-2438-4c94-b32a-0faefe038e40 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:11.334259 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-3c602ebf-2438-4c94-b32a-0faefe038e40 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:11.341651 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3c602ebf-2438-4c94-b32a-0faefe038e40 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:11.342436 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3c602ebf-2438-4c94-b32a-0faefe038e40 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:11.344374 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3c602ebf-2438-4c94-b32a-0faefe038e40 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:11.344991 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3c602ebf-2438-4c94-b32a-0faefe038e40 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:11.475282 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-3c602ebf-2438-4c94-b32a-0faefe038e40 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lazy-loading 'services' on Instance uuid 9bb75a87-2b05-43d3-b570-a04858874b50 {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:40:11.582356 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-dac39801-6b24-4eca-aa98-496ccc1036b9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:11.591384 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-dac39801-6b24-4eca-aa98-496ccc1036b9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1722 microversion: 2.1 time: 0.294636 Jan 10 11:40:11.632416 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 245/490] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:11 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:11.632416 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-29a7ba06-787b-4398-8383-a13293667b21 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:11.632416 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-29a7ba06-787b-4398-8383-a13293667b21 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:11.632416 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-29a7ba06-787b-4398-8383-a13293667b21 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:11.632938 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-29a7ba06-787b-4398-8383-a13293667b21 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:11.632938 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-29a7ba06-787b-4398-8383-a13293667b21 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:11.632938 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-29a7ba06-787b-4398-8383-a13293667b21 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:11.825772 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-29a7ba06-787b-4398-8383-a13293667b21 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:11.833658 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-29a7ba06-787b-4398-8383-a13293667b21 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1317 microversion: 2.1 time: 0.239361 Jan 10 11:40:11.834232 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 246/491] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:11 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:12.281715 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-3683d059-17b0-4280-9729-bde8654170e9 req-9df1395f-aa6a-4b67-9900-8b2ed9c31dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb3777f-32fa-4f8b-8eaf-277e990c233a", "name": "network-vif-plugged", "status": "completed", "tag": "f7b09e29-560e-4123-8100-b592a8c30f4f"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:40:12.285698 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:40:12.285698 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:40:12.303053 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-3683d059-17b0-4280-9729-bde8654170e9 req-9df1395f-aa6a-4b67-9900-8b2ed9c31dca service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:12.303542 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-3683d059-17b0-4280-9729-bde8654170e9 req-9df1395f-aa6a-4b67-9900-8b2ed9c31dca service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:12.312723 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3c602ebf-2438-4c94-b32a-0faefe038e40 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/os-volume_attachments/2097ecd5-5982-4ba9-b10f-dc5138579eb5" status: 202 len: 0 microversion: 2.1 time: 0.983204 Jan 10 11:40:12.314007 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 246/492] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jan 10 11:40:11 2022] DELETE /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/os-volume_attachments/2097ecd5-5982-4ba9-b10f-dc5138579eb5 => generated 0 bytes in 985 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:40:12.330604 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2e598410-2dd6-4260-9c91-06b6265d6c6d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:12.331912 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2e598410-2dd6-4260-9c91-06b6265d6c6d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:12.337227 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-3683d059-17b0-4280-9729-bde8654170e9 req-9df1395f-aa6a-4b67-9900-8b2ed9c31dca service nova] Creating event network-vif-plugged:f7b09e29-560e-4123-8100-b592a8c30f4f for instance ffb3777f-32fa-4f8b-8eaf-277e990c233a on hv-cinder-maste Jan 10 11:40:12.342395 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e598410-2dd6-4260-9c91-06b6265d6c6d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:12.343050 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-3683d059-17b0-4280-9729-bde8654170e9 req-9df1395f-aa6a-4b67-9900-8b2ed9c31dca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064886 Jan 10 11:40:12.343458 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e598410-2dd6-4260-9c91-06b6265d6c6d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:12.344501 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e598410-2dd6-4260-9c91-06b6265d6c6d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:12.344959 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e598410-2dd6-4260-9c91-06b6265d6c6d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:12.347384 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 247/493] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:40:12.355004 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2891fa35-cc1a-44a9-93ed-fcf0908c1c57 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:12.355961 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2891fa35-cc1a-44a9-93ed-fcf0908c1c57 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:12.385547 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2e598410-2dd6-4260-9c91-06b6265d6c6d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067112 Jan 10 11:40:12.387185 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 247/494] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:40:12 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:40:12.387398 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2891fa35-cc1a-44a9-93ed-fcf0908c1c57 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:12.390786 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2891fa35-cc1a-44a9-93ed-fcf0908c1c57 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:12.392001 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2891fa35-cc1a-44a9-93ed-fcf0908c1c57 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:12.392457 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2891fa35-cc1a-44a9-93ed-fcf0908c1c57 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:12.624091 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2891fa35-cc1a-44a9-93ed-fcf0908c1c57 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:12.634892 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2891fa35-cc1a-44a9-93ed-fcf0908c1c57 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:12.636761 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2891fa35-cc1a-44a9-93ed-fcf0908c1c57 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:12.638073 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2891fa35-cc1a-44a9-93ed-fcf0908c1c57 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1738 microversion: 2.20 time: 0.289141 Jan 10 11:40:12.638790 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 248/495] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:12 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1738 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:12.649009 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-73452d5f-eb53-48e4-a133-3f8efb279a65 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:12.650247 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-73452d5f-eb53-48e4-a133-3f8efb279a65 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:12.657424 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-73452d5f-eb53-48e4-a133-3f8efb279a65 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:12.658097 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-73452d5f-eb53-48e4-a133-3f8efb279a65 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:12.659114 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-73452d5f-eb53-48e4-a133-3f8efb279a65 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:12.659989 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-73452d5f-eb53-48e4-a133-3f8efb279a65 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:12.853053 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b4d3cfff-3142-427e-b3e9-87227c1dfb7d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:12.859969 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b4d3cfff-3142-427e-b3e9-87227c1dfb7d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:12.864092 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b4d3cfff-3142-427e-b3e9-87227c1dfb7d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:12.870040 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-73452d5f-eb53-48e4-a133-3f8efb279a65 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:12.871620 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b4d3cfff-3142-427e-b3e9-87227c1dfb7d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:12.876850 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b4d3cfff-3142-427e-b3e9-87227c1dfb7d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:12.878004 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b4d3cfff-3142-427e-b3e9-87227c1dfb7d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:12.881753 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-73452d5f-eb53-48e4-a133-3f8efb279a65 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1722 microversion: 2.1 time: 0.236785 Jan 10 11:40:12.883699 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 248/496] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:12 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:13.087846 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b4d3cfff-3142-427e-b3e9-87227c1dfb7d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:13.095929 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b4d3cfff-3142-427e-b3e9-87227c1dfb7d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1317 microversion: 2.1 time: 0.248501 Jan 10 11:40:13.096801 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 249/497] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:12 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:13.409522 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-768f4170-ea3b-4623-8614-863c9701ec92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:13.411461 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-768f4170-ea3b-4623-8614-863c9701ec92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:13.420893 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-768f4170-ea3b-4623-8614-863c9701ec92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:13.421352 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-768f4170-ea3b-4623-8614-863c9701ec92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:13.422701 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-768f4170-ea3b-4623-8614-863c9701ec92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:13.423347 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-768f4170-ea3b-4623-8614-863c9701ec92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:13.459225 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-768f4170-ea3b-4623-8614-863c9701ec92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064089 Jan 10 11:40:13.460167 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 249/498] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:40:13 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:40:13.661592 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-9dd2ada8-9ad3-41ab-9425-5ebb86778436 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:13.662932 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-9dd2ada8-9ad3-41ab-9425-5ebb86778436 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:13.672179 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9dd2ada8-9ad3-41ab-9425-5ebb86778436 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:13.673177 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9dd2ada8-9ad3-41ab-9425-5ebb86778436 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:13.674406 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9dd2ada8-9ad3-41ab-9425-5ebb86778436 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:13.675090 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9dd2ada8-9ad3-41ab-9425-5ebb86778436 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:13.895837 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-9dd2ada8-9ad3-41ab-9425-5ebb86778436 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:13.905204 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-542f6a83-c3f3-4154-8fcd-f7f674e170a7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:13.906577 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-542f6a83-c3f3-4154-8fcd-f7f674e170a7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:13.908059 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-9dd2ada8-9ad3-41ab-9425-5ebb86778436 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:13.910367 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-9dd2ada8-9ad3-41ab-9425-5ebb86778436 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:13.911931 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-9dd2ada8-9ad3-41ab-9425-5ebb86778436 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1738 microversion: 2.20 time: 0.258036 Jan 10 11:40:13.912712 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 250/499] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:13 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:13.923116 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-542f6a83-c3f3-4154-8fcd-f7f674e170a7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:13.925019 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-542f6a83-c3f3-4154-8fcd-f7f674e170a7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:13.927923 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-542f6a83-c3f3-4154-8fcd-f7f674e170a7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:13.943726 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-542f6a83-c3f3-4154-8fcd-f7f674e170a7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:14.113897 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-6a4a1110-16a5-4cab-8b89-4d8edc74e377 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:14.114561 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-6a4a1110-16a5-4cab-8b89-4d8edc74e377 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:14.134975 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6a4a1110-16a5-4cab-8b89-4d8edc74e377 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:14.135471 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6a4a1110-16a5-4cab-8b89-4d8edc74e377 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:14.140992 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6a4a1110-16a5-4cab-8b89-4d8edc74e377 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:14.140992 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6a4a1110-16a5-4cab-8b89-4d8edc74e377 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:14.270979 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-542f6a83-c3f3-4154-8fcd-f7f674e170a7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:14.282567 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-542f6a83-c3f3-4154-8fcd-f7f674e170a7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1722 microversion: 2.1 time: 0.386255 Jan 10 11:40:14.292930 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 250/500] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:13 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1722 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:14.394198 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-6a4a1110-16a5-4cab-8b89-4d8edc74e377 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:14.403603 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-6a4a1110-16a5-4cab-8b89-4d8edc74e377 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1317 microversion: 2.1 time: 0.293586 Jan 10 11:40:14.407929 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 251/501] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:14 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:14.473795 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-96687dcf-4e2b-4e08-b711-6421b72fe928 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:14.475333 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-96687dcf-4e2b-4e08-b711-6421b72fe928 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:14.506595 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-96687dcf-4e2b-4e08-b711-6421b72fe928 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:14.511548 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-96687dcf-4e2b-4e08-b711-6421b72fe928 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:14.512869 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-96687dcf-4e2b-4e08-b711-6421b72fe928 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:14.518510 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-96687dcf-4e2b-4e08-b711-6421b72fe928 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:14.574775 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-96687dcf-4e2b-4e08-b711-6421b72fe928 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106548 Jan 10 11:40:14.575892 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 251/502] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:40:14 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:40:14.952089 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-19a361d6-4193-432f-a7ab-ac12a1e95f8d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:14.953111 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-19a361d6-4193-432f-a7ab-ac12a1e95f8d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:14.979301 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-19a361d6-4193-432f-a7ab-ac12a1e95f8d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:14.979967 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-19a361d6-4193-432f-a7ab-ac12a1e95f8d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:14.980921 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-19a361d6-4193-432f-a7ab-ac12a1e95f8d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:14.981905 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-19a361d6-4193-432f-a7ab-ac12a1e95f8d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:15.270472 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-19a361d6-4193-432f-a7ab-ac12a1e95f8d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:15.292690 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-19a361d6-4193-432f-a7ab-ac12a1e95f8d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:15.297288 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-19a361d6-4193-432f-a7ab-ac12a1e95f8d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:15.299358 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-19a361d6-4193-432f-a7ab-ac12a1e95f8d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1738 microversion: 2.20 time: 0.364825 Jan 10 11:40:15.311103 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 252/503] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:14 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1738 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:15.316050 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a4815524-bf85-4907-8fcb-6ebe971d205b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:15.316900 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a4815524-bf85-4907-8fcb-6ebe971d205b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:15.330206 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a4815524-bf85-4907-8fcb-6ebe971d205b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:15.331340 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a4815524-bf85-4907-8fcb-6ebe971d205b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:15.332302 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a4815524-bf85-4907-8fcb-6ebe971d205b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:15.332814 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a4815524-bf85-4907-8fcb-6ebe971d205b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:15.422771 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-d2eb6897-0909-4333-b008-d67d918a50cd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:15.423621 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-d2eb6897-0909-4333-b008-d67d918a50cd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:15.434033 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d2eb6897-0909-4333-b008-d67d918a50cd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:15.438332 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d2eb6897-0909-4333-b008-d67d918a50cd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:15.444424 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d2eb6897-0909-4333-b008-d67d918a50cd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:15.445369 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d2eb6897-0909-4333-b008-d67d918a50cd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:15.616066 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a4815524-bf85-4907-8fcb-6ebe971d205b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:15.633954 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a4815524-bf85-4907-8fcb-6ebe971d205b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1699 microversion: 2.1 time: 0.336067 Jan 10 11:40:15.634923 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 252/504] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:15 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1699 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:15.653781 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-8ed93611-217a-43ea-86ca-f8b5edb18d1b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:40:15.660971 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8ed93611-217a-43ea-86ca-f8b5edb18d1b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:15.661426 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8ed93611-217a-43ea-86ca-f8b5edb18d1b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:15.775943 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-8ed93611-217a-43ea-86ca-f8b5edb18d1b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Going to try to start instance {{(pid=128719) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 10 11:40:15.793812 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-d2eb6897-0909-4333-b008-d67d918a50cd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:15.814394 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-d2eb6897-0909-4333-b008-d67d918a50cd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1505 microversion: 2.1 time: 0.385917 Jan 10 11:40:15.814394 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 253/505] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:15 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1505 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:16.330871 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-809eb9f6-0d2e-4493-af07-83fbe51bc582 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:16.331618 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-809eb9f6-0d2e-4493-af07-83fbe51bc582 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:16.338701 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-809eb9f6-0d2e-4493-af07-83fbe51bc582 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:16.339137 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-809eb9f6-0d2e-4493-af07-83fbe51bc582 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:16.342941 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-809eb9f6-0d2e-4493-af07-83fbe51bc582 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:16.344653 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-809eb9f6-0d2e-4493-af07-83fbe51bc582 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:16.502872 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-809eb9f6-0d2e-4493-af07-83fbe51bc582 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:16.511797 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-809eb9f6-0d2e-4493-af07-83fbe51bc582 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:16.513317 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-809eb9f6-0d2e-4493-af07-83fbe51bc582 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:16.514511 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-809eb9f6-0d2e-4493-af07-83fbe51bc582 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1738 microversion: 2.20 time: 0.187324 Jan 10 11:40:16.515077 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 254/506] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:16 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:40:16.813253 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-8ed93611-217a-43ea-86ca-f8b5edb18d1b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 202 len: 0 microversion: 2.1 time: 1.161842 Jan 10 11:40:16.814201 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 253/507] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:40:15 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 0 bytes in 1165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 10 11:40:16.823367 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f76c510f-03b8-4b60-a97e-0db71b0f8605 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:16.824154 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f76c510f-03b8-4b60-a97e-0db71b0f8605 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:16.830492 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f76c510f-03b8-4b60-a97e-0db71b0f8605 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:16.830951 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f76c510f-03b8-4b60-a97e-0db71b0f8605 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:16.831754 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f76c510f-03b8-4b60-a97e-0db71b0f8605 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:16.832201 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f76c510f-03b8-4b60-a97e-0db71b0f8605 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:17.066451 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f76c510f-03b8-4b60-a97e-0db71b0f8605 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:17.105762 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f76c510f-03b8-4b60-a97e-0db71b0f8605 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1708 microversion: 2.1 time: 0.286736 Jan 10 11:40:17.118849 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 255/508] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:16 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1708 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:17.534072 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ad6a1855-44a2-4eac-980d-0f63bd6ca64e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:17.539043 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ad6a1855-44a2-4eac-980d-0f63bd6ca64e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:17.546800 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ad6a1855-44a2-4eac-980d-0f63bd6ca64e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:17.547505 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ad6a1855-44a2-4eac-980d-0f63bd6ca64e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:17.548633 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ad6a1855-44a2-4eac-980d-0f63bd6ca64e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:17.550855 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ad6a1855-44a2-4eac-980d-0f63bd6ca64e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:17.794819 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ad6a1855-44a2-4eac-980d-0f63bd6ca64e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:17.807231 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ad6a1855-44a2-4eac-980d-0f63bd6ca64e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:17.808989 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ad6a1855-44a2-4eac-980d-0f63bd6ca64e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:17.810558 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ad6a1855-44a2-4eac-980d-0f63bd6ca64e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1738 microversion: 2.20 time: 0.281106 Jan 10 11:40:17.811667 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 254/509] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:17 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1738 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:18.128835 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b0e3d373-fbc2-45ce-87b9-5cb28527de0b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:18.129462 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b0e3d373-fbc2-45ce-87b9-5cb28527de0b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:18.139651 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b0e3d373-fbc2-45ce-87b9-5cb28527de0b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:18.141251 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b0e3d373-fbc2-45ce-87b9-5cb28527de0b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:18.141251 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b0e3d373-fbc2-45ce-87b9-5cb28527de0b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:18.141697 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b0e3d373-fbc2-45ce-87b9-5cb28527de0b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:18.221798 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-cd8679b7-fa11-4940-96ea-38bf4d58b1ee tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:18.222348 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-cd8679b7-fa11-4940-96ea-38bf4d58b1ee tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:18.230609 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cd8679b7-fa11-4940-96ea-38bf4d58b1ee tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:18.238602 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cd8679b7-fa11-4940-96ea-38bf4d58b1ee tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:18.238602 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cd8679b7-fa11-4940-96ea-38bf4d58b1ee tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:18.238602 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cd8679b7-fa11-4940-96ea-38bf4d58b1ee tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:18.271029 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-cd8679b7-fa11-4940-96ea-38bf4d58b1ee tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Going to try to terminate instance {{(pid=128719) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:40:18.300125 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b0e3d373-fbc2-45ce-87b9-5cb28527de0b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:18.310503 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b0e3d373-fbc2-45ce-87b9-5cb28527de0b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1708 microversion: 2.1 time: 0.185478 Jan 10 11:40:18.311321 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 256/510] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:18 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1708 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:18.624171 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-412f9550-5c00-419c-b599-a69d8760a053 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3a2b316-c612-4ecf-8c8c-fc7a557095a0"}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:40:18.625293 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-412f9550-5c00-419c-b599-a69d8760a053 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:18.632088 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-412f9550-5c00-419c-b599-a69d8760a053 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:18.632544 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-412f9550-5c00-419c-b599-a69d8760a053 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:18.633892 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-412f9550-5c00-419c-b599-a69d8760a053 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:18.634447 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-412f9550-5c00-419c-b599-a69d8760a053 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:18.809331 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-cd8679b7-fa11-4940-96ea-38bf4d58b1ee tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 204 len: 0 microversion: 2.1 time: 0.590652 Jan 10 11:40:18.809987 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 255/511] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:40:18 2022] DELETE /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:40:18.820622 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-352c2172-ed96-4ea1-bf48-b9a6f467e2ce tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:18.820622 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-352c2172-ed96-4ea1-bf48-b9a6f467e2ce tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:18.825927 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-352c2172-ed96-4ea1-bf48-b9a6f467e2ce tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:18.826514 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-352c2172-ed96-4ea1-bf48-b9a6f467e2ce tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:18.827316 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-352c2172-ed96-4ea1-bf48-b9a6f467e2ce tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:18.827760 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-352c2172-ed96-4ea1-bf48-b9a6f467e2ce tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:18.981565 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-352c2172-ed96-4ea1-bf48-b9a6f467e2ce tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:18.990450 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-352c2172-ed96-4ea1-bf48-b9a6f467e2ce tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1505 microversion: 2.1 time: 0.175918 Jan 10 11:40:18.991129 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 256/512] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:18 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:18.996571 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e8724ea1-6539-4758-a2b7-58a4df39e773 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:18.997262 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-e8724ea1-6539-4758-a2b7-58a4df39e773 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:19.003974 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e8724ea1-6539-4758-a2b7-58a4df39e773 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:19.009601 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e8724ea1-6539-4758-a2b7-58a4df39e773 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:19.009601 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e8724ea1-6539-4758-a2b7-58a4df39e773 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:19.009601 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e8724ea1-6539-4758-a2b7-58a4df39e773 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:19.150959 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-e8724ea1-6539-4758-a2b7-58a4df39e773 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:19.161555 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-e8724ea1-6539-4758-a2b7-58a4df39e773 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:19.163274 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-e8724ea1-6539-4758-a2b7-58a4df39e773 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:19.164454 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-e8724ea1-6539-4758-a2b7-58a4df39e773 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1738 microversion: 2.20 time: 0.172166 Jan 10 11:40:19.165251 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 257/513] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:18 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:19.328912 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-284251fb-a5ae-4d81-9fe4-e1888542a020 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:19.329545 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-284251fb-a5ae-4d81-9fe4-e1888542a020 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:19.335412 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-284251fb-a5ae-4d81-9fe4-e1888542a020 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:19.335869 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-284251fb-a5ae-4d81-9fe4-e1888542a020 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:19.336861 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-284251fb-a5ae-4d81-9fe4-e1888542a020 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:19.337467 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-284251fb-a5ae-4d81-9fe4-e1888542a020 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:19.485391 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-284251fb-a5ae-4d81-9fe4-e1888542a020 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:19.494858 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-284251fb-a5ae-4d81-9fe4-e1888542a020 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1712 microversion: 2.1 time: 0.169795 Jan 10 11:40:19.495440 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 258/514] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:19 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1712 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:19.916636 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-412f9550-5c00-419c-b599-a69d8760a053 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "POST /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.295847 Jan 10 11:40:19.921974 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 257/515] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jan 10 11:40:18 2022] POST /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a/os-volume_attachments => generated 194 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:40:20.010243 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-791094bb-a736-47a2-9075-98413db6b68e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:20.011009 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-791094bb-a736-47a2-9075-98413db6b68e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:20.017429 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-791094bb-a736-47a2-9075-98413db6b68e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:20.017871 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-791094bb-a736-47a2-9075-98413db6b68e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:20.018696 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-791094bb-a736-47a2-9075-98413db6b68e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:20.019149 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-791094bb-a736-47a2-9075-98413db6b68e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:20.187011 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2e2c2b52-b70f-4eab-9dcb-971e217d173e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:20.188251 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2e2c2b52-b70f-4eab-9dcb-971e217d173e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:20.192191 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-791094bb-a736-47a2-9075-98413db6b68e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:20.208776 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-791094bb-a736-47a2-9075-98413db6b68e tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1505 microversion: 2.1 time: 0.201375 Jan 10 11:40:20.210286 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 259/516] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:20 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1505 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:20.217157 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2e2c2b52-b70f-4eab-9dcb-971e217d173e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:20.217817 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2e2c2b52-b70f-4eab-9dcb-971e217d173e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:20.218603 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2e2c2b52-b70f-4eab-9dcb-971e217d173e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:20.219050 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2e2c2b52-b70f-4eab-9dcb-971e217d173e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:20.385949 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2e2c2b52-b70f-4eab-9dcb-971e217d173e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:20.394352 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2e2c2b52-b70f-4eab-9dcb-971e217d173e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:20.397569 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2e2c2b52-b70f-4eab-9dcb-971e217d173e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:20.397569 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2e2c2b52-b70f-4eab-9dcb-971e217d173e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1720 microversion: 2.20 time: 0.214886 Jan 10 11:40:20.404863 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 258/517] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:20 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:21.226985 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-fe831c46-5ea0-4457-b6df-41a90ecdd716 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:21.228274 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-fe831c46-5ea0-4457-b6df-41a90ecdd716 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:21.235189 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fe831c46-5ea0-4457-b6df-41a90ecdd716 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:21.235648 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fe831c46-5ea0-4457-b6df-41a90ecdd716 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:21.236433 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fe831c46-5ea0-4457-b6df-41a90ecdd716 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:21.236869 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fe831c46-5ea0-4457-b6df-41a90ecdd716 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:21.373288 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-fe831c46-5ea0-4457-b6df-41a90ecdd716 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:21.380796 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-fe831c46-5ea0-4457-b6df-41a90ecdd716 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1505 microversion: 2.1 time: 0.157626 Jan 10 11:40:21.381358 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 260/518] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:21 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:21.418400 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-325975bf-f90f-498c-8945-14a9f0efd818 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:21.419015 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-325975bf-f90f-498c-8945-14a9f0efd818 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:21.425975 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-325975bf-f90f-498c-8945-14a9f0efd818 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:21.426497 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-325975bf-f90f-498c-8945-14a9f0efd818 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:21.427267 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-325975bf-f90f-498c-8945-14a9f0efd818 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:21.427704 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-325975bf-f90f-498c-8945-14a9f0efd818 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:21.571917 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-325975bf-f90f-498c-8945-14a9f0efd818 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:21.582237 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-325975bf-f90f-498c-8945-14a9f0efd818 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:21.598342 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-325975bf-f90f-498c-8945-14a9f0efd818 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:21.598342 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-325975bf-f90f-498c-8945-14a9f0efd818 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1720 microversion: 2.20 time: 0.171691 Jan 10 11:40:21.598342 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 259/519] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:21 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:21.836114 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-c9f92ae0-4dc7-4169-ac86-a417f0cc877d req-0073000f-94c1-4fbd-91c4-499f88054447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb58298d-9795-4c2b-86b6-3b17b668765f", "name": "network-vif-unplugged", "status": "completed", "tag": "ad9b761f-8e30-4890-b16f-aceb4777ab0b"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:40:21.838434 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:40:21.838434 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:40:21.845915 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-c9f92ae0-4dc7-4169-ac86-a417f0cc877d req-0073000f-94c1-4fbd-91c4-499f88054447 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:21.846581 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-c9f92ae0-4dc7-4169-ac86-a417f0cc877d req-0073000f-94c1-4fbd-91c4-499f88054447 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:21.858398 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-c9f92ae0-4dc7-4169-ac86-a417f0cc877d req-0073000f-94c1-4fbd-91c4-499f88054447 service nova] Creating event network-vif-unplugged:ad9b761f-8e30-4890-b16f-aceb4777ab0b for instance bb58298d-9795-4c2b-86b6-3b17b668765f on hv-cinder-maste Jan 10 11:40:21.869650 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-c9f92ae0-4dc7-4169-ac86-a417f0cc877d req-0073000f-94c1-4fbd-91c4-499f88054447 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036787 Jan 10 11:40:21.870606 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 261/520] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:40:22.403793 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-69a15e18-ece1-4de6-ac86-0401fbbe5a53 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:22.404669 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-69a15e18-ece1-4de6-ac86-0401fbbe5a53 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:22.416799 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-69a15e18-ece1-4de6-ac86-0401fbbe5a53 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:22.422419 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-69a15e18-ece1-4de6-ac86-0401fbbe5a53 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:22.422419 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-69a15e18-ece1-4de6-ac86-0401fbbe5a53 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:22.422419 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-69a15e18-ece1-4de6-ac86-0401fbbe5a53 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:22.602622 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-69a15e18-ece1-4de6-ac86-0401fbbe5a53 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:22.607068 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5609aad5-9e1f-4701-92d0-c4b5f0556851 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:22.608015 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5609aad5-9e1f-4701-92d0-c4b5f0556851 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:22.612391 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-69a15e18-ece1-4de6-ac86-0401fbbe5a53 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1505 microversion: 2.1 time: 0.212341 Jan 10 11:40:22.621318 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5609aad5-9e1f-4701-92d0-c4b5f0556851 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:22.621873 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5609aad5-9e1f-4701-92d0-c4b5f0556851 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:22.622813 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5609aad5-9e1f-4701-92d0-c4b5f0556851 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:22.625171 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5609aad5-9e1f-4701-92d0-c4b5f0556851 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:22.634586 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 260/521] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:22 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:22.813582 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5609aad5-9e1f-4701-92d0-c4b5f0556851 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:22.824384 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5609aad5-9e1f-4701-92d0-c4b5f0556851 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:22.826918 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5609aad5-9e1f-4701-92d0-c4b5f0556851 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:22.828469 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5609aad5-9e1f-4701-92d0-c4b5f0556851 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1720 microversion: 2.20 time: 0.227276 Jan 10 11:40:22.829602 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 262/522] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:22 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1720 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:40:23.236688 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-193d3e87-e2b6-4757-aa7e-d3234b5e84d4 req-49e4fd72-8ef0-481e-af7d-15dcce72cd70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da86e35-89e4-462a-bac2-19a859b044ef", "name": "network-vif-deleted", "tag": "78489ff4-6ec9-4d77-ad90-108d911867f2"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:40:23.238985 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:40:23.238985 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:40:23.248736 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-193d3e87-e2b6-4757-aa7e-d3234b5e84d4 req-49e4fd72-8ef0-481e-af7d-15dcce72cd70 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:23.249180 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-193d3e87-e2b6-4757-aa7e-d3234b5e84d4 req-49e4fd72-8ef0-481e-af7d-15dcce72cd70 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:23.260538 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-193d3e87-e2b6-4757-aa7e-d3234b5e84d4 req-49e4fd72-8ef0-481e-af7d-15dcce72cd70 service nova] Creating event network-vif-deleted:78489ff4-6ec9-4d77-ad90-108d911867f2 for instance 1da86e35-89e4-462a-bac2-19a859b044ef on hv-cinder-maste Jan 10 11:40:23.265473 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-193d3e87-e2b6-4757-aa7e-d3234b5e84d4 req-49e4fd72-8ef0-481e-af7d-15dcce72cd70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032947 Jan 10 11:40:23.266483 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 261/523] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:40:23.630610 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-353613c0-d42a-4c27-a48d-018afd878600 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:23.631373 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-353613c0-d42a-4c27-a48d-018afd878600 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:23.643227 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-353613c0-d42a-4c27-a48d-018afd878600 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:23.643671 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-353613c0-d42a-4c27-a48d-018afd878600 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:23.644574 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-353613c0-d42a-4c27-a48d-018afd878600 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:23.644885 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-353613c0-d42a-4c27-a48d-018afd878600 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:23.678053 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-353613c0-d42a-4c27-a48d-018afd878600 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:23.678528 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-353613c0-d42a-4c27-a48d-018afd878600 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:23.678987 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-353613c0-d42a-4c27-a48d-018afd878600 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lazy-loading 'fault' on Instance uuid 1da86e35-89e4-462a-bac2-19a859b044ef {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:40:23.742392 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-353613c0-d42a-4c27-a48d-018afd878600 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:23.765748 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-353613c0-d42a-4c27-a48d-018afd878600 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 200 len: 1310 microversion: 2.1 time: 0.138959 Jan 10 11:40:23.766727 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 263/524] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:23 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 1310 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:23.848823 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-d4bb3a80-f75c-407f-a6ee-9bbf328a3322 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:23.849812 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-d4bb3a80-f75c-407f-a6ee-9bbf328a3322 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:23.858557 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d4bb3a80-f75c-407f-a6ee-9bbf328a3322 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:23.859048 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d4bb3a80-f75c-407f-a6ee-9bbf328a3322 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:23.859826 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d4bb3a80-f75c-407f-a6ee-9bbf328a3322 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:23.860525 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d4bb3a80-f75c-407f-a6ee-9bbf328a3322 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:23.999339 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-d4bb3a80-f75c-407f-a6ee-9bbf328a3322 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:24.008189 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-d4bb3a80-f75c-407f-a6ee-9bbf328a3322 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:24.009841 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-d4bb3a80-f75c-407f-a6ee-9bbf328a3322 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:24.011029 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-d4bb3a80-f75c-407f-a6ee-9bbf328a3322 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1663 microversion: 2.20 time: 0.167711 Jan 10 11:40:24.011592 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 262/525] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:23 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1663 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:24.031036 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-258bf313-2e35-4071-840d-d296f52598d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e304fea-a2c0-4003-b92d-1fd930b69614"}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:40:24.032218 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-258bf313-2e35-4071-840d-d296f52598d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:24.038457 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-258bf313-2e35-4071-840d-d296f52598d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:24.038906 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-258bf313-2e35-4071-840d-d296f52598d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:24.040328 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-258bf313-2e35-4071-840d-d296f52598d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:24.040732 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-258bf313-2e35-4071-840d-d296f52598d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:24.782952 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-38136a6f-95d0-4c80-bbf4-35af89d4e7a8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:24.783558 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-38136a6f-95d0-4c80-bbf4-35af89d4e7a8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 1da86e35-89e4-462a-bac2-19a859b044ef] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:24.789602 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-38136a6f-95d0-4c80-bbf4-35af89d4e7a8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:24.790268 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-38136a6f-95d0-4c80-bbf4-35af89d4e7a8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:24.791069 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-38136a6f-95d0-4c80-bbf4-35af89d4e7a8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:24.791505 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-38136a6f-95d0-4c80-bbf4-35af89d4e7a8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:24.805013 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-38136a6f-95d0-4c80-bbf4-35af89d4e7a8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] HTTP exception thrown: Instance 1da86e35-89e4-462a-bac2-19a859b044ef could not be found. Jan 10 11:40:24.805828 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-38136a6f-95d0-4c80-bbf4-35af89d4e7a8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Returning 404 to user: Instance 1da86e35-89e4-462a-bac2-19a859b044ef could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:40:24.813425 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-38136a6f-95d0-4c80-bbf4-35af89d4e7a8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef" status: 404 len: 111 microversion: 2.1 time: 0.027405 Jan 10 11:40:24.813425 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 263/526] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:24 2022] GET /compute/v2.1/servers/1da86e35-89e4-462a-bac2-19a859b044ef => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:40:24.819926 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0360ecf3-3326-44ba-bdf2-5fe04cad317f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:24.820423 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0360ecf3-3326-44ba-bdf2-5fe04cad317f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:24.826976 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0360ecf3-3326-44ba-bdf2-5fe04cad317f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:24.827429 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0360ecf3-3326-44ba-bdf2-5fe04cad317f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:24.828241 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0360ecf3-3326-44ba-bdf2-5fe04cad317f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:24.828737 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0360ecf3-3326-44ba-bdf2-5fe04cad317f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:24.853947 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0360ecf3-3326-44ba-bdf2-5fe04cad317f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Going to try to terminate instance {{(pid=128718) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:40:25.403690 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0360ecf3-3326-44ba-bdf2-5fe04cad317f tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 204 len: 0 microversion: 2.1 time: 0.586970 Jan 10 11:40:25.404209 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 264/527] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:40:24 2022] DELETE /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 10 11:40:25.413056 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-09d7ee1f-df0e-41de-acb0-ed4923f7a679 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:25.413768 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-09d7ee1f-df0e-41de-acb0-ed4923f7a679 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:25.421077 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-09d7ee1f-df0e-41de-acb0-ed4923f7a679 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:25.421622 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-09d7ee1f-df0e-41de-acb0-ed4923f7a679 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:25.422375 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-09d7ee1f-df0e-41de-acb0-ed4923f7a679 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:25.422820 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-09d7ee1f-df0e-41de-acb0-ed4923f7a679 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:25.568332 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-09d7ee1f-df0e-41de-acb0-ed4923f7a679 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:25.579120 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-09d7ee1f-df0e-41de-acb0-ed4923f7a679 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.170197 Jan 10 11:40:25.579914 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 265/528] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:25 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:25.796858 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-258bf313-2e35-4071-840d-d296f52598d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.769677 Jan 10 11:40:25.797514 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 264/529] 10.222.0.20 () {62 vars in 1363 bytes} [Mon Jan 10 11:40:24 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/os-volume_attachments => generated 188 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:40:25.937870 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8130f6ca-3dd8-4f55-8b38-8457142907e8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:40:25.938531 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-8130f6ca-3dd8-4f55-8b38-8457142907e8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:25.945198 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8130f6ca-3dd8-4f55-8b38-8457142907e8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:25.945795 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8130f6ca-3dd8-4f55-8b38-8457142907e8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:25.947519 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8130f6ca-3dd8-4f55-8b38-8457142907e8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:25.948027 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8130f6ca-3dd8-4f55-8b38-8457142907e8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:26.225161 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-8130f6ca-3dd8-4f55-8b38-8457142907e8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action" status: 202 len: 0 microversion: 2.20 time: 0.290639 Jan 10 11:40:26.226239 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 266/530] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:40:25 2022] POST /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:40:26.235914 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-68259421-26e7-4f08-b433-96d5af67ba6c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:26.236843 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-68259421-26e7-4f08-b433-96d5af67ba6c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:26.242873 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-68259421-26e7-4f08-b433-96d5af67ba6c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:26.243358 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-68259421-26e7-4f08-b433-96d5af67ba6c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:26.244208 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-68259421-26e7-4f08-b433-96d5af67ba6c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:26.244644 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-68259421-26e7-4f08-b433-96d5af67ba6c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:26.407344 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-68259421-26e7-4f08-b433-96d5af67ba6c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:26.416666 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-68259421-26e7-4f08-b433-96d5af67ba6c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:26.418276 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-68259421-26e7-4f08-b433-96d5af67ba6c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:26.419452 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-68259421-26e7-4f08-b433-96d5af67ba6c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1749 microversion: 2.20 time: 0.188280 Jan 10 11:40:26.420013 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 265/531] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:26 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1749 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:26.595609 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-dfc59090-31bd-45cb-85d3-eb34a12d4a48 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:26.596221 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-dfc59090-31bd-45cb-85d3-eb34a12d4a48 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:26.603648 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dfc59090-31bd-45cb-85d3-eb34a12d4a48 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:26.604176 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dfc59090-31bd-45cb-85d3-eb34a12d4a48 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:26.604981 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dfc59090-31bd-45cb-85d3-eb34a12d4a48 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:26.605423 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dfc59090-31bd-45cb-85d3-eb34a12d4a48 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:26.688430 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-90ecd17f-cb59-49a6-b9b6-9fc41c44654b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1192161059", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-994919792", "security_groups": [{"name": "tempest-secgroup-smoke-1527186430"}], "networks": [{"uuid": "d629e7a0-5831-410c-81ae-c34bc8000814"}], "block_device_mapping_v2": [{"uuid": "c91de1ed-7521-44da-929c-21050523c754", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:40:26.777055 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-dfc59090-31bd-45cb-85d3-eb34a12d4a48 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:26.784716 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-dfc59090-31bd-45cb-85d3-eb34a12d4a48 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.192840 Jan 10 11:40:26.790694 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 267/532] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:26 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:26.828548 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.network.neutron [None req-90ecd17f-cb59-49a6-b9b6-9fc41c44654b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] validate_networks() for [('d629e7a0-5831-410c-81ae-c34bc8000814', None, None, None, None, None)] {{(pid=128719) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:40:27.277701 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-90ecd17f-cb59-49a6-b9b6-9fc41c44654b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Flavor limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:40:27.278333 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-90ecd17f-cb59-49a6-b9b6-9fc41c44654b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Image limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:40:27.279077 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-90ecd17f-cb59-49a6-b9b6-9fc41c44654b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Flavor pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:40:27.279717 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-90ecd17f-cb59-49a6-b9b6-9fc41c44654b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Image pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:40:27.280162 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-90ecd17f-cb59-49a6-b9b6-9fc41c44654b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:40:27.292714 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-90ecd17f-cb59-49a6-b9b6-9fc41c44654b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:27.293200 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-90ecd17f-cb59-49a6-b9b6-9fc41c44654b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:27.294201 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-90ecd17f-cb59-49a6-b9b6-9fc41c44654b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:27.305962 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-90ecd17f-cb59-49a6-b9b6-9fc41c44654b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:27.311733 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-90ecd17f-cb59-49a6-b9b6-9fc41c44654b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Getting quotas for project 6940c4980bd247c986a305a72a9d1434. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:40:27.315939 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-90ecd17f-cb59-49a6-b9b6-9fc41c44654b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Getting quotas for user 0d9c367e90704768900cf144a1639c27 and project 6940c4980bd247c986a305a72a9d1434. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:40:27.385843 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-90ecd17f-cb59-49a6-b9b6-9fc41c44654b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Going to run 1 instances... {{(pid=128719) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:40:27.388212 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-90ecd17f-cb59-49a6-b9b6-9fc41c44654b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c91de1ed-7521-44da-929c-21050523c754',volume_size=None,volume_type=None)] {{(pid=128719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:40:27.439435 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-21e4eb66-40da-4921-8c3b-769a3529f653 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:27.440173 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-21e4eb66-40da-4921-8c3b-769a3529f653 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:27.446975 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-21e4eb66-40da-4921-8c3b-769a3529f653 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:27.447452 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-21e4eb66-40da-4921-8c3b-769a3529f653 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:27.448232 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-21e4eb66-40da-4921-8c3b-769a3529f653 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:27.448671 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-21e4eb66-40da-4921-8c3b-769a3529f653 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:27.593017 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-21e4eb66-40da-4921-8c3b-769a3529f653 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:27.602714 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-21e4eb66-40da-4921-8c3b-769a3529f653 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:27.604682 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-21e4eb66-40da-4921-8c3b-769a3529f653 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:27.605875 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-21e4eb66-40da-4921-8c3b-769a3529f653 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1749 microversion: 2.20 time: 0.170135 Jan 10 11:40:27.606477 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 268/533] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:27 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:40:27.800772 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0ae1a443-88a0-4983-bddd-701c53cf33f6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:27.803178 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0ae1a443-88a0-4983-bddd-701c53cf33f6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:27.809495 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0ae1a443-88a0-4983-bddd-701c53cf33f6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:27.810074 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0ae1a443-88a0-4983-bddd-701c53cf33f6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:27.810930 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0ae1a443-88a0-4983-bddd-701c53cf33f6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:27.811377 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0ae1a443-88a0-4983-bddd-701c53cf33f6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:27.961007 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0ae1a443-88a0-4983-bddd-701c53cf33f6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:27.969695 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0ae1a443-88a0-4983-bddd-701c53cf33f6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.172573 Jan 10 11:40:27.970452 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 269/534] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:27 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:28.171836 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-90ecd17f-cb59-49a6-b9b6-9fc41c44654b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.492142 Jan 10 11:40:28.172591 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 266/535] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:40:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 10 11:40:28.184088 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-168689e3-eb9b-47ec-8d3b-10b3e0dd0cfc tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:28.184721 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-168689e3-eb9b-47ec-8d3b-10b3e0dd0cfc tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:28.239160 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-168689e3-eb9b-47ec-8d3b-10b3e0dd0cfc tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:28.246425 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-168689e3-eb9b-47ec-8d3b-10b3e0dd0cfc tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1088 microversion: 2.1 time: 0.067122 Jan 10 11:40:28.247260 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 270/536] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:28 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:28.626569 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f713a085-9cbb-48e8-b644-4e7c25dea6ce tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:28.627118 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f713a085-9cbb-48e8-b644-4e7c25dea6ce tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:28.633269 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f713a085-9cbb-48e8-b644-4e7c25dea6ce tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:28.634436 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f713a085-9cbb-48e8-b644-4e7c25dea6ce tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:28.635225 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f713a085-9cbb-48e8-b644-4e7c25dea6ce tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:28.635662 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f713a085-9cbb-48e8-b644-4e7c25dea6ce tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:28.778454 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-f713a085-9cbb-48e8-b644-4e7c25dea6ce tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:28.787437 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-f713a085-9cbb-48e8-b644-4e7c25dea6ce tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:28.788958 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-f713a085-9cbb-48e8-b644-4e7c25dea6ce tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:28.790199 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f713a085-9cbb-48e8-b644-4e7c25dea6ce tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1749 microversion: 2.20 time: 0.167894 Jan 10 11:40:28.790906 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 267/537] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:28 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:28.987336 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-dd687ae0-89e9-495e-adba-73e1b92f905a tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:28.987973 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-dd687ae0-89e9-495e-adba-73e1b92f905a tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:28.995847 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dd687ae0-89e9-495e-adba-73e1b92f905a tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:28.996308 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dd687ae0-89e9-495e-adba-73e1b92f905a tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:28.997116 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dd687ae0-89e9-495e-adba-73e1b92f905a tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:28.997558 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dd687ae0-89e9-495e-adba-73e1b92f905a tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:29.140488 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-dd687ae0-89e9-495e-adba-73e1b92f905a tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:29.148361 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-dd687ae0-89e9-495e-adba-73e1b92f905a tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.164899 Jan 10 11:40:29.149098 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 271/538] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:28 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:29.264676 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-793fb3c2-b0ba-4344-a658-158b8f30006d tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:29.265287 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-793fb3c2-b0ba-4344-a658-158b8f30006d tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:29.321065 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-793fb3c2-b0ba-4344-a658-158b8f30006d tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:29.328003 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-793fb3c2-b0ba-4344-a658-158b8f30006d tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1088 microversion: 2.1 time: 0.066947 Jan 10 11:40:29.328576 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 268/539] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:29 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:29.809036 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7595179a-841b-4364-903f-b7b475e84827 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:29.809552 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7595179a-841b-4364-903f-b7b475e84827 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:29.815886 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7595179a-841b-4364-903f-b7b475e84827 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:29.816343 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7595179a-841b-4364-903f-b7b475e84827 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:29.817172 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7595179a-841b-4364-903f-b7b475e84827 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:29.817608 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7595179a-841b-4364-903f-b7b475e84827 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:29.971921 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7595179a-841b-4364-903f-b7b475e84827 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:29.981138 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7595179a-841b-4364-903f-b7b475e84827 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:29.982770 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7595179a-841b-4364-903f-b7b475e84827 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:29.983961 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7595179a-841b-4364-903f-b7b475e84827 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1749 microversion: 2.20 time: 0.178971 Jan 10 11:40:29.984522 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 272/540] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:29 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1749 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:30.165982 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-fa6763b7-5a4e-4fdc-8be2-b5b7e8b76a98 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:30.166657 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-fa6763b7-5a4e-4fdc-8be2-b5b7e8b76a98 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:30.173309 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fa6763b7-5a4e-4fdc-8be2-b5b7e8b76a98 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:30.173767 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fa6763b7-5a4e-4fdc-8be2-b5b7e8b76a98 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:30.174622 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fa6763b7-5a4e-4fdc-8be2-b5b7e8b76a98 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:30.175065 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fa6763b7-5a4e-4fdc-8be2-b5b7e8b76a98 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:30.346164 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4239aa55-1bda-4b82-992a-d9bb5c14c3fd tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:30.347537 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4239aa55-1bda-4b82-992a-d9bb5c14c3fd tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:30.360824 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4239aa55-1bda-4b82-992a-d9bb5c14c3fd tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:30.361886 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4239aa55-1bda-4b82-992a-d9bb5c14c3fd tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:30.362917 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4239aa55-1bda-4b82-992a-d9bb5c14c3fd tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:30.363506 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4239aa55-1bda-4b82-992a-d9bb5c14c3fd tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:30.375403 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-fa6763b7-5a4e-4fdc-8be2-b5b7e8b76a98 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:30.388770 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-fa6763b7-5a4e-4fdc-8be2-b5b7e8b76a98 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.227154 Jan 10 11:40:30.389638 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 269/541] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:30 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:30.434507 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4239aa55-1bda-4b82-992a-d9bb5c14c3fd tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:30.447748 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4239aa55-1bda-4b82-992a-d9bb5c14c3fd tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1130 microversion: 2.1 time: 0.101046 Jan 10 11:40:30.457590 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 273/542] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:30 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1130 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:30.869514 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-62274846-bb81-4e5b-a0cd-545912afecc5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:30.870017 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-62274846-bb81-4e5b-a0cd-545912afecc5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:30.876323 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-62274846-bb81-4e5b-a0cd-545912afecc5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:30.877047 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-62274846-bb81-4e5b-a0cd-545912afecc5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:30.877865 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-62274846-bb81-4e5b-a0cd-545912afecc5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:30.878618 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-62274846-bb81-4e5b-a0cd-545912afecc5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:30.971345 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-62274846-bb81-4e5b-a0cd-545912afecc5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lazy-loading 'services' on Instance uuid ffb3777f-32fa-4f8b-8eaf-277e990c233a {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:40:31.003740 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-699f1587-fd50-49a0-b229-f29fcb5b7ce4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:31.004198 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-699f1587-fd50-49a0-b229-f29fcb5b7ce4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:31.011194 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-699f1587-fd50-49a0-b229-f29fcb5b7ce4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:31.011615 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-699f1587-fd50-49a0-b229-f29fcb5b7ce4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:31.012935 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-699f1587-fd50-49a0-b229-f29fcb5b7ce4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:31.013377 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-699f1587-fd50-49a0-b229-f29fcb5b7ce4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:31.160249 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-699f1587-fd50-49a0-b229-f29fcb5b7ce4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:31.179948 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-699f1587-fd50-49a0-b229-f29fcb5b7ce4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:31.181833 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-699f1587-fd50-49a0-b229-f29fcb5b7ce4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:31.183429 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-699f1587-fd50-49a0-b229-f29fcb5b7ce4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1751 microversion: 2.20 time: 0.183980 Jan 10 11:40:31.184116 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 274/543] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:30 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:40:31.265796 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-62274846-bb81-4e5b-a0cd-545912afecc5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a/os-volume_attachments/c3a2b316-c612-4ecf-8c8c-fc7a557095a0" status: 202 len: 0 microversion: 2.1 time: 0.400829 Jan 10 11:40:31.266443 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 270/544] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jan 10 11:40:30 2022] DELETE /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a/os-volume_attachments/c3a2b316-c612-4ecf-8c8c-fc7a557095a0 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 10 11:40:31.275299 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-9bc2b6aa-c08b-4a28-8f7e-fbe387659e64 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:31.276304 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-9bc2b6aa-c08b-4a28-8f7e-fbe387659e64 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:31.282424 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9bc2b6aa-c08b-4a28-8f7e-fbe387659e64 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:31.282875 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9bc2b6aa-c08b-4a28-8f7e-fbe387659e64 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:31.283713 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9bc2b6aa-c08b-4a28-8f7e-fbe387659e64 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:31.284250 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9bc2b6aa-c08b-4a28-8f7e-fbe387659e64 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:31.314963 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-9bc2b6aa-c08b-4a28-8f7e-fbe387659e64 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 Jan 10 11:40:31.315540 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 275/545] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:40:31 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:40:31.408552 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-93c38aa4-cc13-47e3-86ea-a791c748bb69 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:31.409219 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-93c38aa4-cc13-47e3-86ea-a791c748bb69 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:31.417777 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-93c38aa4-cc13-47e3-86ea-a791c748bb69 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:31.418261 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-93c38aa4-cc13-47e3-86ea-a791c748bb69 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:31.419494 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-93c38aa4-cc13-47e3-86ea-a791c748bb69 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:31.419938 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-93c38aa4-cc13-47e3-86ea-a791c748bb69 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:31.467672 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c518b2e3-fc42-47ea-a79d-f1991bef3067 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:31.468219 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c518b2e3-fc42-47ea-a79d-f1991bef3067 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:31.474853 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c518b2e3-fc42-47ea-a79d-f1991bef3067 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:31.475306 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c518b2e3-fc42-47ea-a79d-f1991bef3067 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:31.476095 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c518b2e3-fc42-47ea-a79d-f1991bef3067 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:31.476532 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c518b2e3-fc42-47ea-a79d-f1991bef3067 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:31.553149 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c518b2e3-fc42-47ea-a79d-f1991bef3067 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:31.561116 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c518b2e3-fc42-47ea-a79d-f1991bef3067 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1186 microversion: 2.1 time: 0.099342 Jan 10 11:40:31.561701 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 276/546] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:31 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1186 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:31.599912 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-93c38aa4-cc13-47e3-86ea-a791c748bb69 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:31.607938 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-93c38aa4-cc13-47e3-86ea-a791c748bb69 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.204230 Jan 10 11:40:31.608564 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 271/547] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:31 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:32.206556 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3cf7499f-6b8f-475e-8720-71ec8e90df99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:32.207196 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3cf7499f-6b8f-475e-8720-71ec8e90df99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:32.214984 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3cf7499f-6b8f-475e-8720-71ec8e90df99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:32.216017 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3cf7499f-6b8f-475e-8720-71ec8e90df99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:32.216838 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3cf7499f-6b8f-475e-8720-71ec8e90df99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:32.217610 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3cf7499f-6b8f-475e-8720-71ec8e90df99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:32.328795 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-cf199ef0-2ec5-4994-bbc9-3c712308f956 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:32.329851 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-cf199ef0-2ec5-4994-bbc9-3c712308f956 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:32.336523 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cf199ef0-2ec5-4994-bbc9-3c712308f956 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:32.338829 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cf199ef0-2ec5-4994-bbc9-3c712308f956 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:32.339697 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cf199ef0-2ec5-4994-bbc9-3c712308f956 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:32.340150 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cf199ef0-2ec5-4994-bbc9-3c712308f956 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:32.377742 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3cf7499f-6b8f-475e-8720-71ec8e90df99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:32.393963 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-cf199ef0-2ec5-4994-bbc9-3c712308f956 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065831 Jan 10 11:40:32.393963 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 272/548] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:40:32 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:40:32.401756 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3cf7499f-6b8f-475e-8720-71ec8e90df99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:32.419498 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3cf7499f-6b8f-475e-8720-71ec8e90df99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:32.419498 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3cf7499f-6b8f-475e-8720-71ec8e90df99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1751 microversion: 2.20 time: 0.206698 Jan 10 11:40:32.419498 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 277/549] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:32 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1751 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:32.578467 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-24356c0c-4ae4-4780-8d03-32af9f00ca44 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:32.579041 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-24356c0c-4ae4-4780-8d03-32af9f00ca44 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:32.585708 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-24356c0c-4ae4-4780-8d03-32af9f00ca44 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:32.586197 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-24356c0c-4ae4-4780-8d03-32af9f00ca44 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:32.587696 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-24356c0c-4ae4-4780-8d03-32af9f00ca44 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:32.588147 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-24356c0c-4ae4-4780-8d03-32af9f00ca44 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:32.625505 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b22049ae-ae7a-4a9c-b539-50912bcbe22b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:32.627177 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b22049ae-ae7a-4a9c-b539-50912bcbe22b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:32.634839 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b22049ae-ae7a-4a9c-b539-50912bcbe22b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:32.635599 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b22049ae-ae7a-4a9c-b539-50912bcbe22b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:32.636581 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b22049ae-ae7a-4a9c-b539-50912bcbe22b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:32.637076 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b22049ae-ae7a-4a9c-b539-50912bcbe22b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:32.663914 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-24356c0c-4ae4-4780-8d03-32af9f00ca44 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:32.675306 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-24356c0c-4ae4-4780-8d03-32af9f00ca44 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1204 microversion: 2.1 time: 0.100428 Jan 10 11:40:32.677143 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 273/550] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:32 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1204 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:32.784241 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b22049ae-ae7a-4a9c-b539-50912bcbe22b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:32.793868 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b22049ae-ae7a-4a9c-b539-50912bcbe22b tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.171892 Jan 10 11:40:32.794503 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 278/551] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:32 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:33.403584 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ac0ef817-a509-4289-a9bb-14bef28d73f6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:33.404526 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ac0ef817-a509-4289-a9bb-14bef28d73f6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:33.424238 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ac0ef817-a509-4289-a9bb-14bef28d73f6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:33.425003 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ac0ef817-a509-4289-a9bb-14bef28d73f6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:33.425848 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ac0ef817-a509-4289-a9bb-14bef28d73f6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:33.426320 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ac0ef817-a509-4289-a9bb-14bef28d73f6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:33.437560 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8715d7b3-6e3a-49e9-a557-3f1b5e2b4ca8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:33.438911 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-8715d7b3-6e3a-49e9-a557-3f1b5e2b4ca8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:33.446140 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8715d7b3-6e3a-49e9-a557-3f1b5e2b4ca8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:33.447491 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8715d7b3-6e3a-49e9-a557-3f1b5e2b4ca8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:33.448504 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8715d7b3-6e3a-49e9-a557-3f1b5e2b4ca8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:33.449892 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8715d7b3-6e3a-49e9-a557-3f1b5e2b4ca8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:33.466244 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ac0ef817-a509-4289-a9bb-14bef28d73f6 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068956 Jan 10 11:40:33.466844 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 274/552] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:40:33 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:40:33.612689 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-8715d7b3-6e3a-49e9-a557-3f1b5e2b4ca8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:33.624895 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-8715d7b3-6e3a-49e9-a557-3f1b5e2b4ca8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:33.637702 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-8715d7b3-6e3a-49e9-a557-3f1b5e2b4ca8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:33.639863 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-8715d7b3-6e3a-49e9-a557-3f1b5e2b4ca8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.206426 Jan 10 11:40:33.651949 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 279/553] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:33 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:40:33.693827 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5b5a76a4-350b-402f-952e-065bb4ff052b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:33.694679 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5b5a76a4-350b-402f-952e-065bb4ff052b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:33.701037 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5b5a76a4-350b-402f-952e-065bb4ff052b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:33.701681 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5b5a76a4-350b-402f-952e-065bb4ff052b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:33.702515 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5b5a76a4-350b-402f-952e-065bb4ff052b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:33.702965 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5b5a76a4-350b-402f-952e-065bb4ff052b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:33.857044 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-295cc7b1-e947-47a7-a38d-e6e2174dc1f1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:33.859444 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-295cc7b1-e947-47a7-a38d-e6e2174dc1f1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:33.894380 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-295cc7b1-e947-47a7-a38d-e6e2174dc1f1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:33.896568 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-295cc7b1-e947-47a7-a38d-e6e2174dc1f1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:33.900420 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-295cc7b1-e947-47a7-a38d-e6e2174dc1f1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:33.901541 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-295cc7b1-e947-47a7-a38d-e6e2174dc1f1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:33.920989 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5b5a76a4-350b-402f-952e-065bb4ff052b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:33.938370 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5b5a76a4-350b-402f-952e-065bb4ff052b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1272 microversion: 2.1 time: 0.248136 Jan 10 11:40:33.938955 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 275/554] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:33 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:34.125731 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-295cc7b1-e947-47a7-a38d-e6e2174dc1f1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:34.133652 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-295cc7b1-e947-47a7-a38d-e6e2174dc1f1 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.313249 Jan 10 11:40:34.143783 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 280/555] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:33 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:34.284189 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-8bfe3d94-6325-45f8-95ec-7294d9115a9a req-a2e93ee1-abae-419a-a9d5-38803d2a79bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d03071b-bd55-49bb-b290-09cd0a05fe02", "tag": "c48c4206-c204-4d5e-bde8-ec64ab3d966d"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:40:34.286425 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:40:34.286425 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:40:34.294989 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-8bfe3d94-6325-45f8-95ec-7294d9115a9a req-a2e93ee1-abae-419a-a9d5-38803d2a79bf service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:34.295443 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-8bfe3d94-6325-45f8-95ec-7294d9115a9a req-a2e93ee1-abae-419a-a9d5-38803d2a79bf service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:34.312701 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-8bfe3d94-6325-45f8-95ec-7294d9115a9a req-a2e93ee1-abae-419a-a9d5-38803d2a79bf service nova] Creating event network-changed:c48c4206-c204-4d5e-bde8-ec64ab3d966d for instance 3d03071b-bd55-49bb-b290-09cd0a05fe02 on hv-cinder-maste Jan 10 11:40:34.319194 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-8bfe3d94-6325-45f8-95ec-7294d9115a9a req-a2e93ee1-abae-419a-a9d5-38803d2a79bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040144 Jan 10 11:40:34.328859 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 276/556] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:40:34.477002 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8f4c1d74-6586-4fb2-ba85-df30411631d5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:34.479096 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-8f4c1d74-6586-4fb2-ba85-df30411631d5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:34.496811 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8f4c1d74-6586-4fb2-ba85-df30411631d5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:34.497261 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8f4c1d74-6586-4fb2-ba85-df30411631d5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:34.498057 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8f4c1d74-6586-4fb2-ba85-df30411631d5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:34.498860 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8f4c1d74-6586-4fb2-ba85-df30411631d5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:34.534528 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-8f4c1d74-6586-4fb2-ba85-df30411631d5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061225 Jan 10 11:40:34.535032 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 281/557] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:40:34 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:40:34.661284 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5b3f943d-2713-446b-89e7-ed3e3c5ad05b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:34.662580 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5b3f943d-2713-446b-89e7-ed3e3c5ad05b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:34.675317 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5b3f943d-2713-446b-89e7-ed3e3c5ad05b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:34.676225 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5b3f943d-2713-446b-89e7-ed3e3c5ad05b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:34.677725 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5b3f943d-2713-446b-89e7-ed3e3c5ad05b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:34.678548 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5b3f943d-2713-446b-89e7-ed3e3c5ad05b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:34.885861 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5b3f943d-2713-446b-89e7-ed3e3c5ad05b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:34.901665 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5b3f943d-2713-446b-89e7-ed3e3c5ad05b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:34.904794 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5b3f943d-2713-446b-89e7-ed3e3c5ad05b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:34.906873 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5b3f943d-2713-446b-89e7-ed3e3c5ad05b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.251663 Jan 10 11:40:34.908160 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 277/558] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:34 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:34.978953 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-18215454-4de0-45a9-8e0f-ed0dfe96486b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:34.984044 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-18215454-4de0-45a9-8e0f-ed0dfe96486b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:35.022799 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-18215454-4de0-45a9-8e0f-ed0dfe96486b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:35.023602 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-18215454-4de0-45a9-8e0f-ed0dfe96486b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:35.025073 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-18215454-4de0-45a9-8e0f-ed0dfe96486b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:35.026304 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-18215454-4de0-45a9-8e0f-ed0dfe96486b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:35.181733 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-634e83d7-9e78-4419-adaa-a8a519a61001 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:35.190557 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-634e83d7-9e78-4419-adaa-a8a519a61001 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:35.215295 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-18215454-4de0-45a9-8e0f-ed0dfe96486b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:35.216660 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-634e83d7-9e78-4419-adaa-a8a519a61001 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:35.224050 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-634e83d7-9e78-4419-adaa-a8a519a61001 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:35.224050 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-634e83d7-9e78-4419-adaa-a8a519a61001 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:35.224050 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-634e83d7-9e78-4419-adaa-a8a519a61001 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:35.224931 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-18215454-4de0-45a9-8e0f-ed0dfe96486b tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1272 microversion: 2.1 time: 0.269286 Jan 10 11:40:35.226757 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 282/559] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:34 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1272 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:35.390739 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-634e83d7-9e78-4419-adaa-a8a519a61001 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:35.401157 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-634e83d7-9e78-4419-adaa-a8a519a61001 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1522 microversion: 2.1 time: 0.247231 Jan 10 11:40:35.411188 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 278/560] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:35 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:35.932336 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f0dc5381-31f5-427e-b455-1227020628ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:35.933029 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f0dc5381-31f5-427e-b455-1227020628ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:35.940319 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f0dc5381-31f5-427e-b455-1227020628ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:35.940884 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f0dc5381-31f5-427e-b455-1227020628ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:35.941893 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f0dc5381-31f5-427e-b455-1227020628ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:35.942418 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f0dc5381-31f5-427e-b455-1227020628ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:36.089116 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f815b629-e0be-46fd-901d-4d15862e15cc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:36.089708 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f815b629-e0be-46fd-901d-4d15862e15cc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:36.097169 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f815b629-e0be-46fd-901d-4d15862e15cc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:36.097866 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f815b629-e0be-46fd-901d-4d15862e15cc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:36.099305 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f815b629-e0be-46fd-901d-4d15862e15cc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:36.100085 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f815b629-e0be-46fd-901d-4d15862e15cc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:36.122493 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f0dc5381-31f5-427e-b455-1227020628ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:36.133429 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f0dc5381-31f5-427e-b455-1227020628ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:36.135353 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f0dc5381-31f5-427e-b455-1227020628ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:36.136790 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f0dc5381-31f5-427e-b455-1227020628ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.209961 Jan 10 11:40:36.137428 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 283/561] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:35 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:36.147583 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f815b629-e0be-46fd-901d-4d15862e15cc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Going to try to terminate instance {{(pid=128719) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:40:36.255385 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-fac39fb3-52a1-4c9c-8956-36d3e54cb31f tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:36.256043 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-fac39fb3-52a1-4c9c-8956-36d3e54cb31f tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:36.263011 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fac39fb3-52a1-4c9c-8956-36d3e54cb31f tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:36.263463 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fac39fb3-52a1-4c9c-8956-36d3e54cb31f tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:36.264265 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fac39fb3-52a1-4c9c-8956-36d3e54cb31f tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:36.264700 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fac39fb3-52a1-4c9c-8956-36d3e54cb31f tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:36.428360 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-fac39fb3-52a1-4c9c-8956-36d3e54cb31f tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:36.437931 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-fac39fb3-52a1-4c9c-8956-36d3e54cb31f tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1260 microversion: 2.1 time: 0.187057 Jan 10 11:40:36.438929 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 284/562] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:36 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:36.450593 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-c99b58ec-15e7-4df7-956c-5a2debc4e762 req-aa7c1349-f234-499d-ae06-186d57f3b28a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb75a87-2b05-43d3-b570-a04858874b50", "name": "network-vif-deleted", "tag": "94a56965-edf5-4d72-b69a-a0f3ecd10498"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:40:36.452727 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:40:36.452727 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:40:36.460733 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-c99b58ec-15e7-4df7-956c-5a2debc4e762 req-aa7c1349-f234-499d-ae06-186d57f3b28a service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:36.461300 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-c99b58ec-15e7-4df7-956c-5a2debc4e762 req-aa7c1349-f234-499d-ae06-186d57f3b28a service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:36.473616 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-c99b58ec-15e7-4df7-956c-5a2debc4e762 req-aa7c1349-f234-499d-ae06-186d57f3b28a service nova] Creating event network-vif-deleted:94a56965-edf5-4d72-b69a-a0f3ecd10498 for instance 9bb75a87-2b05-43d3-b570-a04858874b50 on hv-cinder-maste Jan 10 11:40:36.479903 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-c99b58ec-15e7-4df7-956c-5a2debc4e762 req-aa7c1349-f234-499d-ae06-186d57f3b28a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039602 Jan 10 11:40:36.489403 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 285/563] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:40:36.496171 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0a41fdc5-b46f-4127-b49e-b16a16750bed tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:36.496956 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0a41fdc5-b46f-4127-b49e-b16a16750bed tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:36.510502 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0a41fdc5-b46f-4127-b49e-b16a16750bed tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:36.511152 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0a41fdc5-b46f-4127-b49e-b16a16750bed tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:36.512114 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0a41fdc5-b46f-4127-b49e-b16a16750bed tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:36.512765 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0a41fdc5-b46f-4127-b49e-b16a16750bed tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:36.582740 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0a41fdc5-b46f-4127-b49e-b16a16750bed tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:36.591701 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0a41fdc5-b46f-4127-b49e-b16a16750bed tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1480 microversion: 2.1 time: 0.100804 Jan 10 11:40:36.601548 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 286/564] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:36 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1480 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:36.626327 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f815b629-e0be-46fd-901d-4d15862e15cc tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 204 len: 0 microversion: 2.1 time: 0.541089 Jan 10 11:40:36.627133 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 279/565] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:40:36 2022] DELETE /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 10 11:40:36.637012 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-5b519bdd-f44f-4bcb-9ebf-d5880d7a99d1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:36.638139 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-5b519bdd-f44f-4bcb-9ebf-d5880d7a99d1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:36.646560 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5b519bdd-f44f-4bcb-9ebf-d5880d7a99d1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:36.647491 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5b519bdd-f44f-4bcb-9ebf-d5880d7a99d1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:36.648478 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5b519bdd-f44f-4bcb-9ebf-d5880d7a99d1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:36.650009 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5b519bdd-f44f-4bcb-9ebf-d5880d7a99d1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:36.799259 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-5b519bdd-f44f-4bcb-9ebf-d5880d7a99d1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:36.808065 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-5b519bdd-f44f-4bcb-9ebf-d5880d7a99d1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1511 microversion: 2.1 time: 0.176174 Jan 10 11:40:36.808534 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 287/566] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:36 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:37.154956 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-c1e002cb-f03b-402d-9445-a8ced27ce81d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:37.155656 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-c1e002cb-f03b-402d-9445-a8ced27ce81d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:37.166386 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c1e002cb-f03b-402d-9445-a8ced27ce81d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:37.167132 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c1e002cb-f03b-402d-9445-a8ced27ce81d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:37.168218 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c1e002cb-f03b-402d-9445-a8ced27ce81d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:37.168874 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c1e002cb-f03b-402d-9445-a8ced27ce81d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:37.316015 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-c1e002cb-f03b-402d-9445-a8ced27ce81d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:37.325670 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-c1e002cb-f03b-402d-9445-a8ced27ce81d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:37.327798 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-c1e002cb-f03b-402d-9445-a8ced27ce81d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:37.329124 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-c1e002cb-f03b-402d-9445-a8ced27ce81d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.178245 Jan 10 11:40:37.329853 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 280/567] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:37 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:40:37.456975 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-bae028bb-e8f0-441e-b813-f42ea84d4d35 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:37.457700 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-bae028bb-e8f0-441e-b813-f42ea84d4d35 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:37.465062 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bae028bb-e8f0-441e-b813-f42ea84d4d35 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:37.465514 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bae028bb-e8f0-441e-b813-f42ea84d4d35 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:37.466351 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bae028bb-e8f0-441e-b813-f42ea84d4d35 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:37.466788 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bae028bb-e8f0-441e-b813-f42ea84d4d35 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:37.608070 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-1ca2d023-909d-4193-863b-34ae5d1de68c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:37.608696 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-1ca2d023-909d-4193-863b-34ae5d1de68c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:37.631217 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1ca2d023-909d-4193-863b-34ae5d1de68c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:37.631667 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1ca2d023-909d-4193-863b-34ae5d1de68c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:37.632480 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1ca2d023-909d-4193-863b-34ae5d1de68c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:37.632914 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1ca2d023-909d-4193-863b-34ae5d1de68c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:37.862301 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-1ca2d023-909d-4193-863b-34ae5d1de68c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:37.874037 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-1ca2d023-909d-4193-863b-34ae5d1de68c tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1480 microversion: 2.1 time: 0.269317 Jan 10 11:40:37.879974 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 281/568] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:37 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1480 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:37.891698 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-bae028bb-e8f0-441e-b813-f42ea84d4d35 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:37.900611 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-84563b6d-d0bf-4269-9066-198584210b18 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:37.902078 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-84563b6d-d0bf-4269-9066-198584210b18 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:37.904133 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-bae028bb-e8f0-441e-b813-f42ea84d4d35 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1260 microversion: 2.1 time: 0.450760 Jan 10 11:40:37.905221 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 288/569] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:37 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1260 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:37.918500 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-84563b6d-d0bf-4269-9066-198584210b18 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:37.919215 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-84563b6d-d0bf-4269-9066-198584210b18 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:37.920176 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-84563b6d-d0bf-4269-9066-198584210b18 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:37.920798 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-84563b6d-d0bf-4269-9066-198584210b18 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:38.090622 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-84563b6d-d0bf-4269-9066-198584210b18 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:38.102055 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-84563b6d-d0bf-4269-9066-198584210b18 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1511 microversion: 2.1 time: 0.220061 Jan 10 11:40:38.103515 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 282/570] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:37 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:38.348421 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a35e7aac-85f3-49e7-9e04-3550cb9fd05f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:38.349009 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a35e7aac-85f3-49e7-9e04-3550cb9fd05f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:38.355098 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a35e7aac-85f3-49e7-9e04-3550cb9fd05f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:38.355550 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a35e7aac-85f3-49e7-9e04-3550cb9fd05f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:38.356348 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a35e7aac-85f3-49e7-9e04-3550cb9fd05f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:38.356838 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a35e7aac-85f3-49e7-9e04-3550cb9fd05f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:38.511303 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-a35e7aac-85f3-49e7-9e04-3550cb9fd05f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:38.520216 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-a35e7aac-85f3-49e7-9e04-3550cb9fd05f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:38.521874 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-a35e7aac-85f3-49e7-9e04-3550cb9fd05f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:38.523162 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a35e7aac-85f3-49e7-9e04-3550cb9fd05f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.178972 Jan 10 11:40:38.523797 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 289/571] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:38 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:38.898836 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-38257b4c-5632-4535-af9a-d37269577e92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:38.899496 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-38257b4c-5632-4535-af9a-d37269577e92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:38.910445 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-38257b4c-5632-4535-af9a-d37269577e92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:38.910904 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-38257b4c-5632-4535-af9a-d37269577e92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:38.911701 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-38257b4c-5632-4535-af9a-d37269577e92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:38.912136 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-38257b4c-5632-4535-af9a-d37269577e92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:38.924961 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-5dbd9a1a-ca9c-4f91-a143-70933b4fe56a tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:38.926682 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-5dbd9a1a-ca9c-4f91-a143-70933b4fe56a tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:38.934685 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5dbd9a1a-ca9c-4f91-a143-70933b4fe56a tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:38.935547 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5dbd9a1a-ca9c-4f91-a143-70933b4fe56a tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:38.938627 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5dbd9a1a-ca9c-4f91-a143-70933b4fe56a tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:38.939160 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5dbd9a1a-ca9c-4f91-a143-70933b4fe56a tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:38.994474 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-38257b4c-5632-4535-af9a-d37269577e92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:39.014480 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-38257b4c-5632-4535-af9a-d37269577e92 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1480 microversion: 2.1 time: 0.121581 Jan 10 11:40:39.025632 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 283/572] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:38 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1480 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:39.120808 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d138340b-7bf1-4b38-ae90-81453daae1a9 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:39.121045 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-5dbd9a1a-ca9c-4f91-a143-70933b4fe56a tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:39.121425 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d138340b-7bf1-4b38-ae90-81453daae1a9 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:39.132140 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d138340b-7bf1-4b38-ae90-81453daae1a9 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:39.133102 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d138340b-7bf1-4b38-ae90-81453daae1a9 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:39.134375 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d138340b-7bf1-4b38-ae90-81453daae1a9 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:39.135000 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d138340b-7bf1-4b38-ae90-81453daae1a9 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:39.139186 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-5dbd9a1a-ca9c-4f91-a143-70933b4fe56a tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1260 microversion: 2.1 time: 0.219823 Jan 10 11:40:39.146252 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 290/573] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:38 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:39.392729 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-d138340b-7bf1-4b38-ae90-81453daae1a9 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:39.403799 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d138340b-7bf1-4b38-ae90-81453daae1a9 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1511 microversion: 2.1 time: 0.287522 Jan 10 11:40:39.404886 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 284/574] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:39 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:39.542710 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f3290de1-3d56-426a-81bf-f399223ab039 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:39.543300 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f3290de1-3d56-426a-81bf-f399223ab039 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:39.550018 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f3290de1-3d56-426a-81bf-f399223ab039 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:39.550529 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f3290de1-3d56-426a-81bf-f399223ab039 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:39.551284 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f3290de1-3d56-426a-81bf-f399223ab039 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:39.554695 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f3290de1-3d56-426a-81bf-f399223ab039 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:39.701938 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f3290de1-3d56-426a-81bf-f399223ab039 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:39.710361 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f3290de1-3d56-426a-81bf-f399223ab039 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:39.712639 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f3290de1-3d56-426a-81bf-f399223ab039 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:39.713823 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f3290de1-3d56-426a-81bf-f399223ab039 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.175482 Jan 10 11:40:39.714409 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 291/575] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:39 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:40.033724 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-72d4dbbe-5ec0-47d2-a450-27f61bd229e6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:40.049945 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-72d4dbbe-5ec0-47d2-a450-27f61bd229e6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:40.049945 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-72d4dbbe-5ec0-47d2-a450-27f61bd229e6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:40.049945 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-72d4dbbe-5ec0-47d2-a450-27f61bd229e6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:40.049945 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-72d4dbbe-5ec0-47d2-a450-27f61bd229e6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:40.050416 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-72d4dbbe-5ec0-47d2-a450-27f61bd229e6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:40.116115 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-72d4dbbe-5ec0-47d2-a450-27f61bd229e6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:40.120672 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-72d4dbbe-5ec0-47d2-a450-27f61bd229e6 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1480 microversion: 2.1 time: 0.090912 Jan 10 11:40:40.121755 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 285/576] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:40 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1480 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:40.156406 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2eeb219a-b2ca-4824-a4fa-fdd5ec0364fe tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:40.157362 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2eeb219a-b2ca-4824-a4fa-fdd5ec0364fe tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:40.170884 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2eeb219a-b2ca-4824-a4fa-fdd5ec0364fe tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:40.173308 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2eeb219a-b2ca-4824-a4fa-fdd5ec0364fe tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:40.174513 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2eeb219a-b2ca-4824-a4fa-fdd5ec0364fe tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:40.174964 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2eeb219a-b2ca-4824-a4fa-fdd5ec0364fe tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:40.327342 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2eeb219a-b2ca-4824-a4fa-fdd5ec0364fe tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:40.335777 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2eeb219a-b2ca-4824-a4fa-fdd5ec0364fe tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1260 microversion: 2.1 time: 0.182994 Jan 10 11:40:40.336628 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 292/577] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:40 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:40.427033 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-1cac32c9-4139-4a34-af81-8bdbc9b28778 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:40.427638 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-1cac32c9-4139-4a34-af81-8bdbc9b28778 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:40.437249 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1cac32c9-4139-4a34-af81-8bdbc9b28778 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:40.437694 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1cac32c9-4139-4a34-af81-8bdbc9b28778 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:40.438522 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1cac32c9-4139-4a34-af81-8bdbc9b28778 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:40.438950 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1cac32c9-4139-4a34-af81-8bdbc9b28778 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:40.594148 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-1cac32c9-4139-4a34-af81-8bdbc9b28778 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:40.602261 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-1cac32c9-4139-4a34-af81-8bdbc9b28778 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1511 microversion: 2.1 time: 0.179073 Jan 10 11:40:40.603701 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 286/578] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:40 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:40.732685 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-eb56083a-beb4-45ff-9067-12d712dc17d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:40.733280 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-eb56083a-beb4-45ff-9067-12d712dc17d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:40.739884 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-eb56083a-beb4-45ff-9067-12d712dc17d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:40.740334 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-eb56083a-beb4-45ff-9067-12d712dc17d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:40.741118 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-eb56083a-beb4-45ff-9067-12d712dc17d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:40.741561 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-eb56083a-beb4-45ff-9067-12d712dc17d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:40.903283 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-eb56083a-beb4-45ff-9067-12d712dc17d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:40.912615 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-eb56083a-beb4-45ff-9067-12d712dc17d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:40.914364 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-eb56083a-beb4-45ff-9067-12d712dc17d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:40.916040 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-eb56083a-beb4-45ff-9067-12d712dc17d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.186891 Jan 10 11:40:40.916534 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 293/579] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:40 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:41.145726 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-66ea9b09-f3f3-422c-81a3-938a046e287d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:41.146824 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-66ea9b09-f3f3-422c-81a3-938a046e287d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:41.158026 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-66ea9b09-f3f3-422c-81a3-938a046e287d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:41.158626 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-66ea9b09-f3f3-422c-81a3-938a046e287d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:41.159811 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-66ea9b09-f3f3-422c-81a3-938a046e287d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:41.160327 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-66ea9b09-f3f3-422c-81a3-938a046e287d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:41.259597 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-66ea9b09-f3f3-422c-81a3-938a046e287d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:41.262515 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-66ea9b09-f3f3-422c-81a3-938a046e287d tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1480 microversion: 2.1 time: 0.126143 Jan 10 11:40:41.263200 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 287/580] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:41 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1480 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:41.353414 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7114d925-99b0-4e7f-9a10-6caee4d0223c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:41.354011 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7114d925-99b0-4e7f-9a10-6caee4d0223c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:41.362614 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7114d925-99b0-4e7f-9a10-6caee4d0223c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:41.374584 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7114d925-99b0-4e7f-9a10-6caee4d0223c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:41.374584 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7114d925-99b0-4e7f-9a10-6caee4d0223c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:41.374584 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7114d925-99b0-4e7f-9a10-6caee4d0223c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:41.548118 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7114d925-99b0-4e7f-9a10-6caee4d0223c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:41.556659 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7114d925-99b0-4e7f-9a10-6caee4d0223c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1260 microversion: 2.1 time: 0.207510 Jan 10 11:40:41.557517 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 294/581] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:41 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:41.620805 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-c4b9aeb5-758f-4c63-8900-d985cb3266d8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:41.621629 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-c4b9aeb5-758f-4c63-8900-d985cb3266d8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:41.628144 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c4b9aeb5-758f-4c63-8900-d985cb3266d8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:41.628597 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c4b9aeb5-758f-4c63-8900-d985cb3266d8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:41.629395 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c4b9aeb5-758f-4c63-8900-d985cb3266d8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:41.629836 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c4b9aeb5-758f-4c63-8900-d985cb3266d8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:41.813755 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-c4b9aeb5-758f-4c63-8900-d985cb3266d8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:41.823061 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-c4b9aeb5-758f-4c63-8900-d985cb3266d8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1511 microversion: 2.1 time: 0.206553 Jan 10 11:40:41.823661 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 288/582] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:41 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:41.934719 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-872f1466-336c-46c9-95e6-a6eccd284b95 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:41.935330 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-872f1466-336c-46c9-95e6-a6eccd284b95 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:41.942535 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-872f1466-336c-46c9-95e6-a6eccd284b95 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:41.942970 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-872f1466-336c-46c9-95e6-a6eccd284b95 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:41.943964 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-872f1466-336c-46c9-95e6-a6eccd284b95 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:41.944399 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-872f1466-336c-46c9-95e6-a6eccd284b95 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:42.099905 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-872f1466-336c-46c9-95e6-a6eccd284b95 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:42.111329 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-872f1466-336c-46c9-95e6-a6eccd284b95 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:42.113146 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-872f1466-336c-46c9-95e6-a6eccd284b95 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:42.114548 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-872f1466-336c-46c9-95e6-a6eccd284b95 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.184312 Jan 10 11:40:42.115933 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 295/583] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:41 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:42.280315 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-934162c8-d779-42c5-a253-0cce8730f8eb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:42.283510 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-934162c8-d779-42c5-a253-0cce8730f8eb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:42.287568 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-934162c8-d779-42c5-a253-0cce8730f8eb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:42.288021 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-934162c8-d779-42c5-a253-0cce8730f8eb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:42.295343 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-934162c8-d779-42c5-a253-0cce8730f8eb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:42.295917 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-934162c8-d779-42c5-a253-0cce8730f8eb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:42.386913 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-934162c8-d779-42c5-a253-0cce8730f8eb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:42.392607 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-934162c8-d779-42c5-a253-0cce8730f8eb tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1480 microversion: 2.1 time: 0.116036 Jan 10 11:40:42.394642 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 289/584] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:42 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1480 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:42.573663 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f9faa2a4-fcf9-4a8e-b7d9-67febdea0f6c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:42.574326 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f9faa2a4-fcf9-4a8e-b7d9-67febdea0f6c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:42.581445 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f9faa2a4-fcf9-4a8e-b7d9-67febdea0f6c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:42.581972 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f9faa2a4-fcf9-4a8e-b7d9-67febdea0f6c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:42.582733 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f9faa2a4-fcf9-4a8e-b7d9-67febdea0f6c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:42.583182 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f9faa2a4-fcf9-4a8e-b7d9-67febdea0f6c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:42.784946 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f9faa2a4-fcf9-4a8e-b7d9-67febdea0f6c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:42.795410 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f9faa2a4-fcf9-4a8e-b7d9-67febdea0f6c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1260 microversion: 2.1 time: 0.226217 Jan 10 11:40:42.809649 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 296/585] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:42 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1260 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:42.841434 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-37832714-9677-4a57-90c1-6d08bde5a8e8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:42.847893 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-37832714-9677-4a57-90c1-6d08bde5a8e8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:42.854643 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-37832714-9677-4a57-90c1-6d08bde5a8e8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:42.858607 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-37832714-9677-4a57-90c1-6d08bde5a8e8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:42.858607 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-37832714-9677-4a57-90c1-6d08bde5a8e8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:42.858607 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-37832714-9677-4a57-90c1-6d08bde5a8e8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:43.020990 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-37832714-9677-4a57-90c1-6d08bde5a8e8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:43.029473 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-37832714-9677-4a57-90c1-6d08bde5a8e8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1511 microversion: 2.1 time: 0.192852 Jan 10 11:40:43.030078 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 290/586] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:42 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:43.135092 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-bf846ddc-04e9-410f-af4f-d2d7d1b76f56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:43.136359 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-bf846ddc-04e9-410f-af4f-d2d7d1b76f56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:43.148678 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bf846ddc-04e9-410f-af4f-d2d7d1b76f56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:43.149144 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bf846ddc-04e9-410f-af4f-d2d7d1b76f56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:43.150079 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bf846ddc-04e9-410f-af4f-d2d7d1b76f56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:43.150589 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bf846ddc-04e9-410f-af4f-d2d7d1b76f56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:43.321232 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-bf846ddc-04e9-410f-af4f-d2d7d1b76f56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:43.330739 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-bf846ddc-04e9-410f-af4f-d2d7d1b76f56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:43.332606 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-bf846ddc-04e9-410f-af4f-d2d7d1b76f56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:43.334022 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-bf846ddc-04e9-410f-af4f-d2d7d1b76f56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.203701 Jan 10 11:40:43.334626 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 297/587] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:43 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:43.410364 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ee7cd991-946c-42e4-ad80-b0db83449224 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:43.411332 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ee7cd991-946c-42e4-ad80-b0db83449224 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:43.419010 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ee7cd991-946c-42e4-ad80-b0db83449224 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:43.422580 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ee7cd991-946c-42e4-ad80-b0db83449224 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:43.422580 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ee7cd991-946c-42e4-ad80-b0db83449224 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:43.422580 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ee7cd991-946c-42e4-ad80-b0db83449224 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:43.492449 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ee7cd991-946c-42e4-ad80-b0db83449224 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:43.501204 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ee7cd991-946c-42e4-ad80-b0db83449224 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1480 microversion: 2.1 time: 0.094646 Jan 10 11:40:43.502035 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 291/588] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:43 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1480 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:43.818525 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-6b74762b-c307-45e2-bb68-00c8ea4cfaab tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:43.819569 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-6b74762b-c307-45e2-bb68-00c8ea4cfaab tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:43.828819 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6b74762b-c307-45e2-bb68-00c8ea4cfaab tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:43.829406 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6b74762b-c307-45e2-bb68-00c8ea4cfaab tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:43.830391 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6b74762b-c307-45e2-bb68-00c8ea4cfaab tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:43.830875 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6b74762b-c307-45e2-bb68-00c8ea4cfaab tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:44.010427 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-6b74762b-c307-45e2-bb68-00c8ea4cfaab tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:44.031080 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-6b74762b-c307-45e2-bb68-00c8ea4cfaab tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1260 microversion: 2.1 time: 0.217308 Jan 10 11:40:44.034141 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 298/589] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:43 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:44.046912 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-16f2075f-65da-4487-be64-a3d61444a878 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:44.047722 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-16f2075f-65da-4487-be64-a3d61444a878 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:44.062044 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-16f2075f-65da-4487-be64-a3d61444a878 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:44.062527 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-16f2075f-65da-4487-be64-a3d61444a878 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:44.063331 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-16f2075f-65da-4487-be64-a3d61444a878 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:44.064026 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-16f2075f-65da-4487-be64-a3d61444a878 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:44.220150 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-16f2075f-65da-4487-be64-a3d61444a878 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:44.227772 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-16f2075f-65da-4487-be64-a3d61444a878 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1511 microversion: 2.1 time: 0.184703 Jan 10 11:40:44.228367 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 292/590] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:44 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1511 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:44.352280 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-375a5c9c-77c9-4503-b2c1-e71b6d4a1eb6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:44.353263 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-375a5c9c-77c9-4503-b2c1-e71b6d4a1eb6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:44.360396 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-375a5c9c-77c9-4503-b2c1-e71b6d4a1eb6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:44.361558 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-375a5c9c-77c9-4503-b2c1-e71b6d4a1eb6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:44.362675 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-375a5c9c-77c9-4503-b2c1-e71b6d4a1eb6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:44.363360 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-375a5c9c-77c9-4503-b2c1-e71b6d4a1eb6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:44.513249 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-375a5c9c-77c9-4503-b2c1-e71b6d4a1eb6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:44.523862 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-375a5c9c-77c9-4503-b2c1-e71b6d4a1eb6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:44.529540 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-375a5c9c-77c9-4503-b2c1-e71b6d4a1eb6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:44.530342 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-375a5c9c-77c9-4503-b2c1-e71b6d4a1eb6 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.181651 Jan 10 11:40:44.530731 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 299/591] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:44 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:44.532955 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-72f0ca0b-a734-4437-8123-31d1367bf1d7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:44.533954 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-72f0ca0b-a734-4437-8123-31d1367bf1d7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:44.561193 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-72f0ca0b-a734-4437-8123-31d1367bf1d7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:44.561653 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-72f0ca0b-a734-4437-8123-31d1367bf1d7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:44.562486 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-72f0ca0b-a734-4437-8123-31d1367bf1d7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:44.562936 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-72f0ca0b-a734-4437-8123-31d1367bf1d7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:44.637644 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-72f0ca0b-a734-4437-8123-31d1367bf1d7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:44.645842 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-72f0ca0b-a734-4437-8123-31d1367bf1d7 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1480 microversion: 2.1 time: 0.125129 Jan 10 11:40:44.646560 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 293/592] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:44 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1480 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:45.049707 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-48bc5ca2-c56b-4ac1-a918-0827189a2c97 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:45.050343 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-48bc5ca2-c56b-4ac1-a918-0827189a2c97 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:45.057435 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-48bc5ca2-c56b-4ac1-a918-0827189a2c97 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:45.057890 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-48bc5ca2-c56b-4ac1-a918-0827189a2c97 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:45.058776 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-48bc5ca2-c56b-4ac1-a918-0827189a2c97 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:45.059220 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-48bc5ca2-c56b-4ac1-a918-0827189a2c97 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:45.199888 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-48bc5ca2-c56b-4ac1-a918-0827189a2c97 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:45.207321 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-48bc5ca2-c56b-4ac1-a918-0827189a2c97 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1260 microversion: 2.1 time: 0.161273 Jan 10 11:40:45.207819 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 300/593] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:45 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:45.244956 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-abba0837-8759-4caf-a760-5165244317bd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:45.245567 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-abba0837-8759-4caf-a760-5165244317bd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:45.251948 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-abba0837-8759-4caf-a760-5165244317bd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:45.252398 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-abba0837-8759-4caf-a760-5165244317bd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:45.253204 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-abba0837-8759-4caf-a760-5165244317bd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:45.253644 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-abba0837-8759-4caf-a760-5165244317bd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:45.406080 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-abba0837-8759-4caf-a760-5165244317bd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:45.414158 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-abba0837-8759-4caf-a760-5165244317bd tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1511 microversion: 2.1 time: 0.172743 Jan 10 11:40:45.415828 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 294/594] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:45 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:45.551262 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4757a2a7-8ee8-49a3-9cbb-fa20c9cd5504 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:45.551841 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4757a2a7-8ee8-49a3-9cbb-fa20c9cd5504 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:45.558754 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4757a2a7-8ee8-49a3-9cbb-fa20c9cd5504 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:45.563488 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4757a2a7-8ee8-49a3-9cbb-fa20c9cd5504 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:45.563488 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4757a2a7-8ee8-49a3-9cbb-fa20c9cd5504 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:45.563488 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4757a2a7-8ee8-49a3-9cbb-fa20c9cd5504 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:45.664377 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2f012299-6274-4435-9b46-7731afa609c8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:45.665099 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2f012299-6274-4435-9b46-7731afa609c8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:45.673893 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2f012299-6274-4435-9b46-7731afa609c8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:45.674408 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2f012299-6274-4435-9b46-7731afa609c8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:45.675251 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2f012299-6274-4435-9b46-7731afa609c8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:45.675697 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2f012299-6274-4435-9b46-7731afa609c8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:45.716268 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4757a2a7-8ee8-49a3-9cbb-fa20c9cd5504 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:45.725134 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4757a2a7-8ee8-49a3-9cbb-fa20c9cd5504 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:45.726818 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4757a2a7-8ee8-49a3-9cbb-fa20c9cd5504 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:45.728457 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4757a2a7-8ee8-49a3-9cbb-fa20c9cd5504 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.180939 Jan 10 11:40:45.739806 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 301/595] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:45 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:45.752170 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2f012299-6274-4435-9b46-7731afa609c8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:45.820475 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2f012299-6274-4435-9b46-7731afa609c8 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1307 microversion: 2.1 time: 0.101516 Jan 10 11:40:45.820475 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 295/596] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:45 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:46.227797 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-acc405f1-dadc-4616-b2e8-84750328604c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:46.228883 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-acc405f1-dadc-4616-b2e8-84750328604c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:46.236054 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-acc405f1-dadc-4616-b2e8-84750328604c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:46.239206 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-acc405f1-dadc-4616-b2e8-84750328604c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:46.239206 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-acc405f1-dadc-4616-b2e8-84750328604c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:46.239206 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-acc405f1-dadc-4616-b2e8-84750328604c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:46.380035 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-acc405f1-dadc-4616-b2e8-84750328604c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:46.387945 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-acc405f1-dadc-4616-b2e8-84750328604c tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1260 microversion: 2.1 time: 0.167367 Jan 10 11:40:46.389992 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 302/597] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:46 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:46.437031 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-478c42ad-d58a-42ff-a080-d2a86bdae970 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:46.437772 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-478c42ad-d58a-42ff-a080-d2a86bdae970 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:46.444236 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-478c42ad-d58a-42ff-a080-d2a86bdae970 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:46.444696 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-478c42ad-d58a-42ff-a080-d2a86bdae970 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:46.445638 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-478c42ad-d58a-42ff-a080-d2a86bdae970 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:46.445964 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-478c42ad-d58a-42ff-a080-d2a86bdae970 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:46.602404 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-478c42ad-d58a-42ff-a080-d2a86bdae970 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:46.610668 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-478c42ad-d58a-42ff-a080-d2a86bdae970 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1511 microversion: 2.1 time: 0.177162 Jan 10 11:40:46.611789 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 296/598] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:46 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:46.746896 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-96a349ed-bd24-49c1-abf0-6afd9caa8986 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:46.747497 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-96a349ed-bd24-49c1-abf0-6afd9caa8986 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:46.754183 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-96a349ed-bd24-49c1-abf0-6afd9caa8986 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:46.754672 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-96a349ed-bd24-49c1-abf0-6afd9caa8986 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:46.755495 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-96a349ed-bd24-49c1-abf0-6afd9caa8986 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:46.755924 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-96a349ed-bd24-49c1-abf0-6afd9caa8986 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:46.836786 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-6bc27143-89c5-4e4e-b411-17f134d68792 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:46.837934 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-6bc27143-89c5-4e4e-b411-17f134d68792 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:46.844287 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6bc27143-89c5-4e4e-b411-17f134d68792 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:46.844736 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6bc27143-89c5-4e4e-b411-17f134d68792 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:46.845515 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6bc27143-89c5-4e4e-b411-17f134d68792 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:46.845946 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6bc27143-89c5-4e4e-b411-17f134d68792 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:46.878852 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6bc27143-89c5-4e4e-b411-17f134d68792 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:46.879307 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6bc27143-89c5-4e4e-b411-17f134d68792 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:46.879755 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-6bc27143-89c5-4e4e-b411-17f134d68792 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lazy-loading 'fault' on Instance uuid 9bb75a87-2b05-43d3-b570-a04858874b50 {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:40:46.917012 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-96a349ed-bd24-49c1-abf0-6afd9caa8986 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:46.926140 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-6bc27143-89c5-4e4e-b411-17f134d68792 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14216d42be0e4e1690f9a77a09e25967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77ddb5f1ea14e54be79c194a288b5a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:46.926725 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-96a349ed-bd24-49c1-abf0-6afd9caa8986 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:46.928285 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-96a349ed-bd24-49c1-abf0-6afd9caa8986 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:46.929510 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-96a349ed-bd24-49c1-abf0-6afd9caa8986 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.186481 Jan 10 11:40:46.930079 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 303/599] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:46 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:46.951742 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-6bc27143-89c5-4e4e-b411-17f134d68792 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 200 len: 1312 microversion: 2.1 time: 0.118702 Jan 10 11:40:46.952343 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 297/600] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:46 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 1312 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:47.404839 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e031027f-a1f0-4312-9e32-b91c4eb83fe3 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:47.405448 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e031027f-a1f0-4312-9e32-b91c4eb83fe3 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:47.411496 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e031027f-a1f0-4312-9e32-b91c4eb83fe3 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:47.411945 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e031027f-a1f0-4312-9e32-b91c4eb83fe3 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:47.412720 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e031027f-a1f0-4312-9e32-b91c4eb83fe3 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:47.413150 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e031027f-a1f0-4312-9e32-b91c4eb83fe3 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:47.586481 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-e031027f-a1f0-4312-9e32-b91c4eb83fe3 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:47.594652 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e031027f-a1f0-4312-9e32-b91c4eb83fe3 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1260 microversion: 2.1 time: 0.193414 Jan 10 11:40:47.595350 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 304/601] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:47 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:47.628569 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-c788ded3-79b3-4bfb-bd65-8b0f572f2623 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:47.629352 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-c788ded3-79b3-4bfb-bd65-8b0f572f2623 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:47.636801 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c788ded3-79b3-4bfb-bd65-8b0f572f2623 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:47.637255 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c788ded3-79b3-4bfb-bd65-8b0f572f2623 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:47.638063 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c788ded3-79b3-4bfb-bd65-8b0f572f2623 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:47.638536 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c788ded3-79b3-4bfb-bd65-8b0f572f2623 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:47.799503 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-c788ded3-79b3-4bfb-bd65-8b0f572f2623 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:47.808106 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-c788ded3-79b3-4bfb-bd65-8b0f572f2623 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1511 microversion: 2.1 time: 0.183138 Jan 10 11:40:47.808913 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 298/602] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:47 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1511 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:47.950036 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-916d1573-2aa7-480e-bc70-d02ef40ddcc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:47.950797 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-916d1573-2aa7-480e-bc70-d02ef40ddcc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:47.957079 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-916d1573-2aa7-480e-bc70-d02ef40ddcc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:47.957669 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-916d1573-2aa7-480e-bc70-d02ef40ddcc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:47.958597 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-916d1573-2aa7-480e-bc70-d02ef40ddcc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:47.959532 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-916d1573-2aa7-480e-bc70-d02ef40ddcc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:47.970970 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-0e8ffe49-29b6-48c8-ada2-9d06da9d0882 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:47.972305 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-0e8ffe49-29b6-48c8-ada2-9d06da9d0882 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] [instance: 9bb75a87-2b05-43d3-b570-a04858874b50] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:47.985237 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0e8ffe49-29b6-48c8-ada2-9d06da9d0882 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:47.985237 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0e8ffe49-29b6-48c8-ada2-9d06da9d0882 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:47.985237 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0e8ffe49-29b6-48c8-ada2-9d06da9d0882 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:47.985237 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0e8ffe49-29b6-48c8-ada2-9d06da9d0882 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:48.001422 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-0e8ffe49-29b6-48c8-ada2-9d06da9d0882 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] HTTP exception thrown: Instance 9bb75a87-2b05-43d3-b570-a04858874b50 could not be found. Jan 10 11:40:48.002302 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-0e8ffe49-29b6-48c8-ada2-9d06da9d0882 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] Returning 404 to user: Instance 9bb75a87-2b05-43d3-b570-a04858874b50 could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:40:48.003247 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-0e8ffe49-29b6-48c8-ada2-9d06da9d0882 tempest-ServerRescueNegativeTestJSON-721523256 tempest-ServerRescueNegativeTestJSON-721523256-project] 10.222.0.20 "GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50" status: 404 len: 111 microversion: 2.1 time: 0.036582 Jan 10 11:40:48.007658 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 299/603] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:47 2022] GET /compute/v2.1/servers/9bb75a87-2b05-43d3-b570-a04858874b50 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 10 11:40:48.266261 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-916d1573-2aa7-480e-bc70-d02ef40ddcc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:48.276232 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-916d1573-2aa7-480e-bc70-d02ef40ddcc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:48.278004 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-916d1573-2aa7-480e-bc70-d02ef40ddcc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:48.279386 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-916d1573-2aa7-480e-bc70-d02ef40ddcc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.334281 Jan 10 11:40:48.280061 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 305/604] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:47 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:48.485082 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-5f021a9d-877c-4674-9281-c5fdb340c8c8 req-199f8bc3-1055-4252-89ee-fc0fd1d13337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffb3777f-32fa-4f8b-8eaf-277e990c233a", "name": "network-vif-deleted", "tag": "f7b09e29-560e-4123-8100-b592a8c30f4f"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:40:48.488868 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:40:48.488868 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:40:48.501254 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-5f021a9d-877c-4674-9281-c5fdb340c8c8 req-199f8bc3-1055-4252-89ee-fc0fd1d13337 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:48.502365 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-5f021a9d-877c-4674-9281-c5fdb340c8c8 req-199f8bc3-1055-4252-89ee-fc0fd1d13337 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:48.522233 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-5f021a9d-877c-4674-9281-c5fdb340c8c8 req-199f8bc3-1055-4252-89ee-fc0fd1d13337 service nova] Creating event network-vif-deleted:f7b09e29-560e-4123-8100-b592a8c30f4f for instance ffb3777f-32fa-4f8b-8eaf-277e990c233a on hv-cinder-maste Jan 10 11:40:48.528021 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-5f021a9d-877c-4674-9281-c5fdb340c8c8 req-199f8bc3-1055-4252-89ee-fc0fd1d13337 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050205 Jan 10 11:40:48.528622 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 300/605] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:40:48.615871 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2f04f4e7-9bf5-45bb-a1eb-6868ff55fa67 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:48.616625 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2f04f4e7-9bf5-45bb-a1eb-6868ff55fa67 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:48.623253 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2f04f4e7-9bf5-45bb-a1eb-6868ff55fa67 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:48.623799 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2f04f4e7-9bf5-45bb-a1eb-6868ff55fa67 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:48.624731 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2f04f4e7-9bf5-45bb-a1eb-6868ff55fa67 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:48.625243 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2f04f4e7-9bf5-45bb-a1eb-6868ff55fa67 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:48.826368 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2043b4bc-f813-47ab-af16-6ad20dcae886 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:48.827080 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2043b4bc-f813-47ab-af16-6ad20dcae886 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:48.833333 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2043b4bc-f813-47ab-af16-6ad20dcae886 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:48.833786 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2043b4bc-f813-47ab-af16-6ad20dcae886 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:48.834619 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2043b4bc-f813-47ab-af16-6ad20dcae886 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:48.835238 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2043b4bc-f813-47ab-af16-6ad20dcae886 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:48.943920 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2f04f4e7-9bf5-45bb-a1eb-6868ff55fa67 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:48.946413 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2043b4bc-f813-47ab-af16-6ad20dcae886 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:48.955395 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2f04f4e7-9bf5-45bb-a1eb-6868ff55fa67 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1260 microversion: 2.1 time: 0.343127 Jan 10 11:40:48.956662 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 306/606] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:48 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1260 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:48.956910 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2043b4bc-f813-47ab-af16-6ad20dcae886 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 200 len: 1302 microversion: 2.1 time: 0.134379 Jan 10 11:40:48.958699 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 301/607] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:48 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 1302 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:49.301865 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-89db8a73-e236-4a54-b904-05b914bf8f61 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:49.302937 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-89db8a73-e236-4a54-b904-05b914bf8f61 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:49.310144 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-89db8a73-e236-4a54-b904-05b914bf8f61 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:49.310887 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-89db8a73-e236-4a54-b904-05b914bf8f61 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:49.311673 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-89db8a73-e236-4a54-b904-05b914bf8f61 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:49.312279 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-89db8a73-e236-4a54-b904-05b914bf8f61 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:49.778853 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-89db8a73-e236-4a54-b904-05b914bf8f61 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:49.791740 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-89db8a73-e236-4a54-b904-05b914bf8f61 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:49.796080 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-89db8a73-e236-4a54-b904-05b914bf8f61 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:49.796080 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-89db8a73-e236-4a54-b904-05b914bf8f61 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.497758 Jan 10 11:40:49.798456 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 307/608] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:49 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:49.981021 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-479b4114-278e-4336-b4d5-d19e77d6dda4 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:49.982329 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-479b4114-278e-4336-b4d5-d19e77d6dda4 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:49.989413 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-479b4114-278e-4336-b4d5-d19e77d6dda4 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:49.990151 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-479b4114-278e-4336-b4d5-d19e77d6dda4 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:49.991156 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-479b4114-278e-4336-b4d5-d19e77d6dda4 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:49.991768 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7c5a2bed-b382-42af-b729-e31c1e9e1338 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:49.992248 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-479b4114-278e-4336-b4d5-d19e77d6dda4 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:49.992550 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7c5a2bed-b382-42af-b729-e31c1e9e1338 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: ffb3777f-32fa-4f8b-8eaf-277e990c233a] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:50.003642 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7c5a2bed-b382-42af-b729-e31c1e9e1338 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:50.005020 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7c5a2bed-b382-42af-b729-e31c1e9e1338 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:50.007257 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7c5a2bed-b382-42af-b729-e31c1e9e1338 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:50.011293 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7c5a2bed-b382-42af-b729-e31c1e9e1338 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:50.035426 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-7c5a2bed-b382-42af-b729-e31c1e9e1338 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] HTTP exception thrown: Instance ffb3777f-32fa-4f8b-8eaf-277e990c233a could not be found. Jan 10 11:40:50.036312 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7c5a2bed-b382-42af-b729-e31c1e9e1338 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Returning 404 to user: Instance ffb3777f-32fa-4f8b-8eaf-277e990c233a could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:40:50.037309 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7c5a2bed-b382-42af-b729-e31c1e9e1338 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a" status: 404 len: 111 microversion: 2.1 time: 0.056069 Jan 10 11:40:50.038039 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 308/609] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:49 2022] GET /compute/v2.1/servers/ffb3777f-32fa-4f8b-8eaf-277e990c233a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 10 11:40:50.116698 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-6c5da596-03aa-4abf-97fe-9ef4e26d5778 req-d6d50554-99f3-4892-93ee-a3a716319089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d03071b-bd55-49bb-b290-09cd0a05fe02", "name": "network-vif-plugged", "status": "completed", "tag": "c48c4206-c204-4d5e-bde8-ec64ab3d966d"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:40:50.116698 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:40:50.116698 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:40:50.120742 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-6c5da596-03aa-4abf-97fe-9ef4e26d5778 req-d6d50554-99f3-4892-93ee-a3a716319089 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:50.121597 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-6c5da596-03aa-4abf-97fe-9ef4e26d5778 req-d6d50554-99f3-4892-93ee-a3a716319089 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:50.135847 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-6c5da596-03aa-4abf-97fe-9ef4e26d5778 req-d6d50554-99f3-4892-93ee-a3a716319089 service nova] Creating event network-vif-plugged:c48c4206-c204-4d5e-bde8-ec64ab3d966d for instance 3d03071b-bd55-49bb-b290-09cd0a05fe02 on hv-cinder-maste Jan 10 11:40:50.141171 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-6c5da596-03aa-4abf-97fe-9ef4e26d5778 req-d6d50554-99f3-4892-93ee-a3a716319089 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036004 Jan 10 11:40:50.142183 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 309/610] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:40:50.257062 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-479b4114-278e-4336-b4d5-d19e77d6dda4 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:50.265562 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-479b4114-278e-4336-b4d5-d19e77d6dda4 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1260 microversion: 2.1 time: 0.289590 Jan 10 11:40:50.266863 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 302/611] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:49 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1260 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:50.814815 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-dfc1772e-3120-4a04-a588-296e07be42e2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:50.815570 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-dfc1772e-3120-4a04-a588-296e07be42e2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:50.823185 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dfc1772e-3120-4a04-a588-296e07be42e2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:50.823559 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dfc1772e-3120-4a04-a588-296e07be42e2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:50.824574 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dfc1772e-3120-4a04-a588-296e07be42e2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:50.825221 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dfc1772e-3120-4a04-a588-296e07be42e2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:50.981084 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-dfc1772e-3120-4a04-a588-296e07be42e2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:50.994697 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-dfc1772e-3120-4a04-a588-296e07be42e2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:50.996438 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-dfc1772e-3120-4a04-a588-296e07be42e2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:50.998008 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-dfc1772e-3120-4a04-a588-296e07be42e2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.188244 Jan 10 11:40:50.998682 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 310/612] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:50 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:51.291568 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d27f0aeb-e914-4f3c-8b53-bf3a6ee85540 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:51.292157 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d27f0aeb-e914-4f3c-8b53-bf3a6ee85540 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:51.298560 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d27f0aeb-e914-4f3c-8b53-bf3a6ee85540 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:51.299024 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d27f0aeb-e914-4f3c-8b53-bf3a6ee85540 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:51.299839 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d27f0aeb-e914-4f3c-8b53-bf3a6ee85540 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:51.300281 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d27f0aeb-e914-4f3c-8b53-bf3a6ee85540 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:51.471733 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-d27f0aeb-e914-4f3c-8b53-bf3a6ee85540 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:51.474578 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d27f0aeb-e914-4f3c-8b53-bf3a6ee85540 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1260 microversion: 2.1 time: 0.187797 Jan 10 11:40:51.475149 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 303/613] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:51 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:51.591320 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-209338b4-e47e-458a-9fb3-c03f858220c4 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:51.591832 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-209338b4-e47e-458a-9fb3-c03f858220c4 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:51.598682 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-209338b4-e47e-458a-9fb3-c03f858220c4 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:51.599146 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-209338b4-e47e-458a-9fb3-c03f858220c4 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:51.599949 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-209338b4-e47e-458a-9fb3-c03f858220c4 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:51.600394 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-209338b4-e47e-458a-9fb3-c03f858220c4 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:51.632256 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-209338b4-e47e-458a-9fb3-c03f858220c4 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Going to try to terminate instance {{(pid=128718) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:40:51.960263 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-209338b4-e47e-458a-9fb3-c03f858220c4 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 204 len: 0 microversion: 2.1 time: 0.373245 Jan 10 11:40:51.961309 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 311/614] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:40:51 2022] DELETE /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:40:51.971406 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-92107227-60b6-4592-936a-c5bd105bc1f7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:51.972269 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-92107227-60b6-4592-936a-c5bd105bc1f7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:51.982154 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-92107227-60b6-4592-936a-c5bd105bc1f7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:51.982653 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-92107227-60b6-4592-936a-c5bd105bc1f7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:51.983486 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-92107227-60b6-4592-936a-c5bd105bc1f7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:51.983938 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-92107227-60b6-4592-936a-c5bd105bc1f7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:52.017911 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7d902c3b-7949-4dd4-ac48-447105b39e36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:52.018853 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7d902c3b-7949-4dd4-ac48-447105b39e36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:52.029186 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7d902c3b-7949-4dd4-ac48-447105b39e36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:52.029630 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7d902c3b-7949-4dd4-ac48-447105b39e36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:52.031375 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7d902c3b-7949-4dd4-ac48-447105b39e36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:52.035452 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7d902c3b-7949-4dd4-ac48-447105b39e36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:52.280019 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7d902c3b-7949-4dd4-ac48-447105b39e36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:52.286138 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7d902c3b-7949-4dd4-ac48-447105b39e36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:52.287974 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7d902c3b-7949-4dd4-ac48-447105b39e36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:52.289542 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7d902c3b-7949-4dd4-ac48-447105b39e36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.277108 Jan 10 11:40:52.303248 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-92107227-60b6-4592-936a-c5bd105bc1f7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:52.304344 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 312/615] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:52 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:52.305343 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-92107227-60b6-4592-936a-c5bd105bc1f7 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1512 microversion: 2.1 time: 0.337619 Jan 10 11:40:52.306613 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 304/616] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:51 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1512 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:52.494245 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-066386b0-5392-45d1-9c45-a4c43a93f113 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:52.494962 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-066386b0-5392-45d1-9c45-a4c43a93f113 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:52.503415 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-066386b0-5392-45d1-9c45-a4c43a93f113 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:52.504139 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-066386b0-5392-45d1-9c45-a4c43a93f113 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:52.511033 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-066386b0-5392-45d1-9c45-a4c43a93f113 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:52.511033 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-066386b0-5392-45d1-9c45-a4c43a93f113 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:52.679772 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-066386b0-5392-45d1-9c45-a4c43a93f113 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:52.690515 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-066386b0-5392-45d1-9c45-a4c43a93f113 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1445 microversion: 2.1 time: 0.199900 Jan 10 11:40:52.691112 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 313/617] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:52 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1445 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:52.707278 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-35425f0b-0b3a-46e5-928e-a6733ce1ee24 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:52.707894 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-35425f0b-0b3a-46e5-928e-a6733ce1ee24 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:52.714305 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-35425f0b-0b3a-46e5-928e-a6733ce1ee24 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:52.717126 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-35425f0b-0b3a-46e5-928e-a6733ce1ee24 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:52.717126 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-35425f0b-0b3a-46e5-928e-a6733ce1ee24 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:52.717126 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-35425f0b-0b3a-46e5-928e-a6733ce1ee24 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:52.874755 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-35425f0b-0b3a-46e5-928e-a6733ce1ee24 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:52.881735 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-35425f0b-0b3a-46e5-928e-a6733ce1ee24 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1445 microversion: 2.1 time: 0.177969 Jan 10 11:40:52.882326 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 305/618] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:52 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1445 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:53.312168 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2206a391-a062-434e-aede-0599a6021606 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:53.314964 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2206a391-a062-434e-aede-0599a6021606 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:53.322043 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2206a391-a062-434e-aede-0599a6021606 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:53.322623 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2206a391-a062-434e-aede-0599a6021606 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:53.323593 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2206a391-a062-434e-aede-0599a6021606 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:53.324031 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2206a391-a062-434e-aede-0599a6021606 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:53.328502 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9d8218ca-aea9-4a2a-8ea8-e87905371f0d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:53.337898 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9d8218ca-aea9-4a2a-8ea8-e87905371f0d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:53.353591 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9d8218ca-aea9-4a2a-8ea8-e87905371f0d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:53.354040 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9d8218ca-aea9-4a2a-8ea8-e87905371f0d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:53.354869 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9d8218ca-aea9-4a2a-8ea8-e87905371f0d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:53.355307 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9d8218ca-aea9-4a2a-8ea8-e87905371f0d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:53.554182 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2206a391-a062-434e-aede-0599a6021606 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:53.566985 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2206a391-a062-434e-aede-0599a6021606 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:53.570619 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2206a391-a062-434e-aede-0599a6021606 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:53.575138 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2206a391-a062-434e-aede-0599a6021606 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.264605 Jan 10 11:40:53.588329 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9d8218ca-aea9-4a2a-8ea8-e87905371f0d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:53.588554 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 314/619] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:53 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:53.598549 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9d8218ca-aea9-4a2a-8ea8-e87905371f0d tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1512 microversion: 2.1 time: 0.277803 Jan 10 11:40:53.599460 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 306/620] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:53 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1512 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:54.000528 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-1f8413e8-ab5e-4ec0-adb3-f7fe1f50fc3e req-32525bf8-3084-4e68-96c2-48f1bd54010a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb58298d-9795-4c2b-86b6-3b17b668765f", "name": "network-vif-plugged", "status": "completed", "tag": "ad9b761f-8e30-4890-b16f-aceb4777ab0b"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:40:54.003165 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:40:54.003165 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:40:54.010312 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-1f8413e8-ab5e-4ec0-adb3-f7fe1f50fc3e req-32525bf8-3084-4e68-96c2-48f1bd54010a service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:54.014682 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-1f8413e8-ab5e-4ec0-adb3-f7fe1f50fc3e req-32525bf8-3084-4e68-96c2-48f1bd54010a service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:54.022271 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-1f8413e8-ab5e-4ec0-adb3-f7fe1f50fc3e req-32525bf8-3084-4e68-96c2-48f1bd54010a service nova] Creating event network-vif-plugged:ad9b761f-8e30-4890-b16f-aceb4777ab0b for instance bb58298d-9795-4c2b-86b6-3b17b668765f on hv-cinder-maste Jan 10 11:40:54.027550 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-1f8413e8-ab5e-4ec0-adb3-f7fe1f50fc3e req-32525bf8-3084-4e68-96c2-48f1bd54010a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030871 Jan 10 11:40:54.028251 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 315/621] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:40:54.599671 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-eef90f39-ee19-43fd-ba6e-b9072b3a6e3b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:54.600324 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-eef90f39-ee19-43fd-ba6e-b9072b3a6e3b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:54.608315 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-eef90f39-ee19-43fd-ba6e-b9072b3a6e3b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:54.609065 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-eef90f39-ee19-43fd-ba6e-b9072b3a6e3b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:54.609939 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-eef90f39-ee19-43fd-ba6e-b9072b3a6e3b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:54.610633 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-eef90f39-ee19-43fd-ba6e-b9072b3a6e3b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:54.620765 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-78667c0b-e2f8-4636-a10c-45b7511c9fb1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:54.621517 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-78667c0b-e2f8-4636-a10c-45b7511c9fb1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:54.641156 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-78667c0b-e2f8-4636-a10c-45b7511c9fb1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:54.645630 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-78667c0b-e2f8-4636-a10c-45b7511c9fb1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:54.646776 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-78667c0b-e2f8-4636-a10c-45b7511c9fb1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:54.647599 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-78667c0b-e2f8-4636-a10c-45b7511c9fb1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:54.884299 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-78667c0b-e2f8-4636-a10c-45b7511c9fb1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:54.886228 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-eef90f39-ee19-43fd-ba6e-b9072b3a6e3b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:54.892944 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-78667c0b-e2f8-4636-a10c-45b7511c9fb1 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1512 microversion: 2.1 time: 0.278315 Jan 10 11:40:54.893551 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 316/622] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:54 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1512 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:40:54.895860 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-eef90f39-ee19-43fd-ba6e-b9072b3a6e3b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:54.897627 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-eef90f39-ee19-43fd-ba6e-b9072b3a6e3b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:54.899118 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-eef90f39-ee19-43fd-ba6e-b9072b3a6e3b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.303933 Jan 10 11:40:54.911154 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 307/623] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:54 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:55.355075 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-e2f66b08-1e6b-447c-ba8c-c0b04b26dd0c req-2090736d-04ad-4ed2-930a-332c1ea2ffc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff525c9-af1a-4b34-9c03-56f07ebd1d96", "name": "network-vif-deleted", "tag": "521ffce9-574e-43ff-9566-482167228f8f"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:40:55.358079 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:40:55.358079 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:40:55.370829 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-e2f66b08-1e6b-447c-ba8c-c0b04b26dd0c req-2090736d-04ad-4ed2-930a-332c1ea2ffc4 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:55.371244 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-e2f66b08-1e6b-447c-ba8c-c0b04b26dd0c req-2090736d-04ad-4ed2-930a-332c1ea2ffc4 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:55.393478 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-e2f66b08-1e6b-447c-ba8c-c0b04b26dd0c req-2090736d-04ad-4ed2-930a-332c1ea2ffc4 service nova] Creating event network-vif-deleted:521ffce9-574e-43ff-9566-482167228f8f for instance 9ff525c9-af1a-4b34-9c03-56f07ebd1d96 on hv-cinder-maste Jan 10 11:40:55.402654 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-e2f66b08-1e6b-447c-ba8c-c0b04b26dd0c req-2090736d-04ad-4ed2-930a-332c1ea2ffc4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053093 Jan 10 11:40:55.403551 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 317/624] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:40:55.910090 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d1699af9-376c-4ae5-b821-87a21357bc48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:55.911349 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d1699af9-376c-4ae5-b821-87a21357bc48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:55.918390 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d1699af9-376c-4ae5-b821-87a21357bc48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:55.919451 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d1699af9-376c-4ae5-b821-87a21357bc48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:55.920402 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d1699af9-376c-4ae5-b821-87a21357bc48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:55.920572 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a16ded69-60bc-48d1-bf8e-439286efd9ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:55.921479 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a16ded69-60bc-48d1-bf8e-439286efd9ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:55.921790 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d1699af9-376c-4ae5-b821-87a21357bc48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:55.948270 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a16ded69-60bc-48d1-bf8e-439286efd9ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:55.949147 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a16ded69-60bc-48d1-bf8e-439286efd9ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:55.951192 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a16ded69-60bc-48d1-bf8e-439286efd9ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:55.952702 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a16ded69-60bc-48d1-bf8e-439286efd9ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:55.964651 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d1699af9-376c-4ae5-b821-87a21357bc48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:55.965097 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d1699af9-376c-4ae5-b821-87a21357bc48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:55.965725 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-d1699af9-376c-4ae5-b821-87a21357bc48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lazy-loading 'fault' on Instance uuid 9ff525c9-af1a-4b34-9c03-56f07ebd1d96 {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:40:56.010746 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-d1699af9-376c-4ae5-b821-87a21357bc48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:56.018931 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d1699af9-376c-4ae5-b821-87a21357bc48 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 200 len: 1308 microversion: 2.1 time: 0.112425 Jan 10 11:40:56.019518 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 308/625] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:55 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 1308 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:56.137665 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-a16ded69-60bc-48d1-bf8e-439286efd9ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:56.154686 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-a16ded69-60bc-48d1-bf8e-439286efd9ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:56.154686 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-a16ded69-60bc-48d1-bf8e-439286efd9ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:56.154686 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a16ded69-60bc-48d1-bf8e-439286efd9ed tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.234069 Jan 10 11:40:56.155072 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 318/626] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:55 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:57.036524 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9a8683f6-9c06-4f23-aaae-7c6baad76c70 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:57.037220 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9a8683f6-9c06-4f23-aaae-7c6baad76c70 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 9ff525c9-af1a-4b34-9c03-56f07ebd1d96] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:57.045207 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9a8683f6-9c06-4f23-aaae-7c6baad76c70 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:57.045664 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9a8683f6-9c06-4f23-aaae-7c6baad76c70 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:57.046491 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9a8683f6-9c06-4f23-aaae-7c6baad76c70 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:57.046924 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9a8683f6-9c06-4f23-aaae-7c6baad76c70 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:57.064977 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-9a8683f6-9c06-4f23-aaae-7c6baad76c70 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] HTTP exception thrown: Instance 9ff525c9-af1a-4b34-9c03-56f07ebd1d96 could not be found. Jan 10 11:40:57.065585 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9a8683f6-9c06-4f23-aaae-7c6baad76c70 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Returning 404 to user: Instance 9ff525c9-af1a-4b34-9c03-56f07ebd1d96 could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:40:57.066462 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9a8683f6-9c06-4f23-aaae-7c6baad76c70 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96" status: 404 len: 111 microversion: 2.1 time: 0.033708 Jan 10 11:40:57.070750 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 309/627] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:57 2022] GET /compute/v2.1/servers/9ff525c9-af1a-4b34-9c03-56f07ebd1d96 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:40:57.079144 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e3867094-6f54-4d59-89ab-bde44046d84b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:57.079739 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e3867094-6f54-4d59-89ab-bde44046d84b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:57.086707 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e3867094-6f54-4d59-89ab-bde44046d84b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:57.087217 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e3867094-6f54-4d59-89ab-bde44046d84b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:57.089125 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e3867094-6f54-4d59-89ab-bde44046d84b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:57.089874 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e3867094-6f54-4d59-89ab-bde44046d84b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:57.123483 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e3867094-6f54-4d59-89ab-bde44046d84b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Going to try to terminate instance {{(pid=128718) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:40:57.170653 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e7fdf3e9-d14d-4425-a853-0a8ccc535978 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:57.171398 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-e7fdf3e9-d14d-4425-a853-0a8ccc535978 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:57.177496 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e7fdf3e9-d14d-4425-a853-0a8ccc535978 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:57.179504 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e7fdf3e9-d14d-4425-a853-0a8ccc535978 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:57.179504 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e7fdf3e9-d14d-4425-a853-0a8ccc535978 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:57.179504 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e7fdf3e9-d14d-4425-a853-0a8ccc535978 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:57.329344 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-e7fdf3e9-d14d-4425-a853-0a8ccc535978 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:57.338167 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-e7fdf3e9-d14d-4425-a853-0a8ccc535978 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:57.339765 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-e7fdf3e9-d14d-4425-a853-0a8ccc535978 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:57.340933 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-e7fdf3e9-d14d-4425-a853-0a8ccc535978 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.174205 Jan 10 11:40:57.341486 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 310/628] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:57 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:57.422117 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-44abefc0-09a3-4009-8ff0-9ea056d2024d req-22e8858e-3d74-4222-8703-93d2f4a10438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d03071b-bd55-49bb-b290-09cd0a05fe02", "tag": "c48c4206-c204-4d5e-bde8-ec64ab3d966d"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:40:57.424144 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:40:57.424144 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:40:57.431728 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-44abefc0-09a3-4009-8ff0-9ea056d2024d req-22e8858e-3d74-4222-8703-93d2f4a10438 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:57.432173 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-44abefc0-09a3-4009-8ff0-9ea056d2024d req-22e8858e-3d74-4222-8703-93d2f4a10438 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:57.443475 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-44abefc0-09a3-4009-8ff0-9ea056d2024d req-22e8858e-3d74-4222-8703-93d2f4a10438 service nova] Creating event network-changed:c48c4206-c204-4d5e-bde8-ec64ab3d966d for instance 3d03071b-bd55-49bb-b290-09cd0a05fe02 on hv-cinder-maste Jan 10 11:40:57.448367 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-44abefc0-09a3-4009-8ff0-9ea056d2024d req-22e8858e-3d74-4222-8703-93d2f4a10438 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030852 Jan 10 11:40:57.449015 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 311/629] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:40:57.747888 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e3867094-6f54-4d59-89ab-bde44046d84b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 204 len: 0 microversion: 2.1 time: 0.672342 Jan 10 11:40:57.748487 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 319/630] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:40:57 2022] DELETE /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 0 bytes in 674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:40:57.758819 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3a8ae492-5401-4e1e-a00d-c075d588d681 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:57.760331 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-3a8ae492-5401-4e1e-a00d-c075d588d681 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:57.767268 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3a8ae492-5401-4e1e-a00d-c075d588d681 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:57.767673 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3a8ae492-5401-4e1e-a00d-c075d588d681 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:57.768530 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3a8ae492-5401-4e1e-a00d-c075d588d681 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:57.768953 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3a8ae492-5401-4e1e-a00d-c075d588d681 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:57.924192 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-3a8ae492-5401-4e1e-a00d-c075d588d681 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:57.933720 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3a8ae492-5401-4e1e-a00d-c075d588d681 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1513 microversion: 2.1 time: 0.179943 Jan 10 11:40:57.943172 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 312/631] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:57 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:58.367964 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-55d5d7d4-7437-4654-af1f-c36848c7ed99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:58.367964 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-55d5d7d4-7437-4654-af1f-c36848c7ed99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:58.367964 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-55d5d7d4-7437-4654-af1f-c36848c7ed99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:58.369642 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-55d5d7d4-7437-4654-af1f-c36848c7ed99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:58.370475 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-55d5d7d4-7437-4654-af1f-c36848c7ed99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:58.370927 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-55d5d7d4-7437-4654-af1f-c36848c7ed99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:58.529300 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-55d5d7d4-7437-4654-af1f-c36848c7ed99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:58.538600 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-55d5d7d4-7437-4654-af1f-c36848c7ed99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:58.540987 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-55d5d7d4-7437-4654-af1f-c36848c7ed99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:58.542907 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-55d5d7d4-7437-4654-af1f-c36848c7ed99 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1807 microversion: 2.20 time: 0.186430 Jan 10 11:40:58.543498 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 320/632] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:58 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:40:58.949829 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2a408166-88c2-4e97-8b43-fa539ab0cd9b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:58.950575 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2a408166-88c2-4e97-8b43-fa539ab0cd9b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:58.957098 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a408166-88c2-4e97-8b43-fa539ab0cd9b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:58.957469 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a408166-88c2-4e97-8b43-fa539ab0cd9b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:58.958278 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a408166-88c2-4e97-8b43-fa539ab0cd9b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:58.958719 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a408166-88c2-4e97-8b43-fa539ab0cd9b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:59.094887 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2a408166-88c2-4e97-8b43-fa539ab0cd9b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:59.102563 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2a408166-88c2-4e97-8b43-fa539ab0cd9b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1513 microversion: 2.1 time: 0.156644 Jan 10 11:40:59.112207 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 313/633] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:40:58 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:40:59.563210 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7e059e88-f174-481c-916a-98b02f5fa097 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:40:59.563851 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7e059e88-f174-481c-916a-98b02f5fa097 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:40:59.570377 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7e059e88-f174-481c-916a-98b02f5fa097 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:59.570841 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7e059e88-f174-481c-916a-98b02f5fa097 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:59.572328 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7e059e88-f174-481c-916a-98b02f5fa097 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:40:59.572864 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7e059e88-f174-481c-916a-98b02f5fa097 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:40:59.714289 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7e059e88-f174-481c-916a-98b02f5fa097 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:59.723265 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7e059e88-f174-481c-916a-98b02f5fa097 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:59.724683 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7e059e88-f174-481c-916a-98b02f5fa097 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:40:59.725881 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7e059e88-f174-481c-916a-98b02f5fa097 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1794 microversion: 2.20 time: 0.167451 Jan 10 11:40:59.726489 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 321/634] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:40:59 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1794 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:41:00.070837 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-ed0b2d1a-3c54-4fc3-aa1b-18bf8aec2fd9 req-76a9d8d6-5fd8-4cc1-98e9-ac5528288eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dcee495-de1c-4d5b-9bee-3c6444b9094d", "name": "network-vif-deleted", "tag": "1ecb83fe-4c4e-4c26-a55a-834028f08a68"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:41:00.073321 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:41:00.073321 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:41:00.080807 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-ed0b2d1a-3c54-4fc3-aa1b-18bf8aec2fd9 req-76a9d8d6-5fd8-4cc1-98e9-ac5528288eba service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:00.081522 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-ed0b2d1a-3c54-4fc3-aa1b-18bf8aec2fd9 req-76a9d8d6-5fd8-4cc1-98e9-ac5528288eba service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:00.093510 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-ed0b2d1a-3c54-4fc3-aa1b-18bf8aec2fd9 req-76a9d8d6-5fd8-4cc1-98e9-ac5528288eba service nova] Creating event network-vif-deleted:1ecb83fe-4c4e-4c26-a55a-834028f08a68 for instance 8dcee495-de1c-4d5b-9bee-3c6444b9094d on hv-cinder-maste Jan 10 11:41:00.098618 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-ed0b2d1a-3c54-4fc3-aa1b-18bf8aec2fd9 req-76a9d8d6-5fd8-4cc1-98e9-ac5528288eba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031279 Jan 10 11:41:00.099259 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 314/635] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:41:00.119900 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ffdb929e-e5d8-49d3-9341-7a284ebe9429 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:00.120510 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ffdb929e-e5d8-49d3-9341-7a284ebe9429 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:00.126741 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ffdb929e-e5d8-49d3-9341-7a284ebe9429 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:00.127209 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ffdb929e-e5d8-49d3-9341-7a284ebe9429 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:00.128021 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ffdb929e-e5d8-49d3-9341-7a284ebe9429 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:00.128416 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ffdb929e-e5d8-49d3-9341-7a284ebe9429 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:00.191625 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ffdb929e-e5d8-49d3-9341-7a284ebe9429 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:00.200524 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ffdb929e-e5d8-49d3-9341-7a284ebe9429 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 200 len: 1471 microversion: 2.1 time: 0.084346 Jan 10 11:41:00.201113 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 322/636] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:00 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 1471 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:01.217863 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-4ef65e45-c2e7-4c93-999a-b7342554e086 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:01.218715 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-4ef65e45-c2e7-4c93-999a-b7342554e086 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 8dcee495-de1c-4d5b-9bee-3c6444b9094d] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:01.226008 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4ef65e45-c2e7-4c93-999a-b7342554e086 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:01.226627 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4ef65e45-c2e7-4c93-999a-b7342554e086 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:01.227483 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4ef65e45-c2e7-4c93-999a-b7342554e086 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:01.228130 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4ef65e45-c2e7-4c93-999a-b7342554e086 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:01.242139 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-4ef65e45-c2e7-4c93-999a-b7342554e086 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] HTTP exception thrown: Instance 8dcee495-de1c-4d5b-9bee-3c6444b9094d could not be found. Jan 10 11:41:01.242758 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-4ef65e45-c2e7-4c93-999a-b7342554e086 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Returning 404 to user: Instance 8dcee495-de1c-4d5b-9bee-3c6444b9094d could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:41:01.244112 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-4ef65e45-c2e7-4c93-999a-b7342554e086 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d" status: 404 len: 111 microversion: 2.1 time: 0.029758 Jan 10 11:41:01.245110 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 315/637] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:01 2022] GET /compute/v2.1/servers/8dcee495-de1c-4d5b-9bee-3c6444b9094d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:41:02.584089 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-af1d6299-0528-4f67-ab80-958e43997589 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:02.584626 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-af1d6299-0528-4f67-ab80-958e43997589 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:02.591649 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-af1d6299-0528-4f67-ab80-958e43997589 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:02.592106 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-af1d6299-0528-4f67-ab80-958e43997589 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:02.592899 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-af1d6299-0528-4f67-ab80-958e43997589 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:02.593343 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-af1d6299-0528-4f67-ab80-958e43997589 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:02.619730 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-af1d6299-0528-4f67-ab80-958e43997589 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Going to try to terminate instance {{(pid=128718) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:41:02.976474 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-af1d6299-0528-4f67-ab80-958e43997589 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "DELETE /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 204 len: 0 microversion: 2.1 time: 0.395799 Jan 10 11:41:02.977404 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 323/638] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:41:02 2022] DELETE /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:41:02.986128 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-18ac6b8c-339d-4c86-a968-194292b546e2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:02.986913 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-18ac6b8c-339d-4c86-a968-194292b546e2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:02.993402 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-18ac6b8c-339d-4c86-a968-194292b546e2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:02.994443 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-18ac6b8c-339d-4c86-a968-194292b546e2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:03.005366 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-18ac6b8c-339d-4c86-a968-194292b546e2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:03.005366 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-18ac6b8c-339d-4c86-a968-194292b546e2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:03.136689 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-18ac6b8c-339d-4c86-a968-194292b546e2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:03.144896 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-18ac6b8c-339d-4c86-a968-194292b546e2 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1512 microversion: 2.1 time: 0.162468 Jan 10 11:41:03.145460 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 316/639] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:02 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:04.162950 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-392928df-8510-4937-91ae-186b3f4a8695 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:04.163663 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-392928df-8510-4937-91ae-186b3f4a8695 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:04.171330 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-392928df-8510-4937-91ae-186b3f4a8695 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:04.171783 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-392928df-8510-4937-91ae-186b3f4a8695 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:04.172581 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-392928df-8510-4937-91ae-186b3f4a8695 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:04.173020 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-392928df-8510-4937-91ae-186b3f4a8695 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:04.310945 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-392928df-8510-4937-91ae-186b3f4a8695 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:04.318356 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-392928df-8510-4937-91ae-186b3f4a8695 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1512 microversion: 2.1 time: 0.159758 Jan 10 11:41:04.318932 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 324/640] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:04 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:05.300213 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-32bd9c06-e7d8-4dbf-b69d-f15ab1aabf00 req-6e996e75-aaf6-4c8f-a707-dc2638a927b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17641f31-456c-4c0f-8f40-5337b16bc6e0", "name": "network-vif-deleted", "tag": "6d5c4e49-c1c6-44b3-8b26-b44d2d601cbc"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:41:05.301725 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:41:05.301725 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:41:05.309216 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-32bd9c06-e7d8-4dbf-b69d-f15ab1aabf00 req-6e996e75-aaf6-4c8f-a707-dc2638a927b3 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:05.309656 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-32bd9c06-e7d8-4dbf-b69d-f15ab1aabf00 req-6e996e75-aaf6-4c8f-a707-dc2638a927b3 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:05.320633 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-32bd9c06-e7d8-4dbf-b69d-f15ab1aabf00 req-6e996e75-aaf6-4c8f-a707-dc2638a927b3 service nova] Creating event network-vif-deleted:6d5c4e49-c1c6-44b3-8b26-b44d2d601cbc for instance 17641f31-456c-4c0f-8f40-5337b16bc6e0 on hv-cinder-maste Jan 10 11:41:05.326148 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-32bd9c06-e7d8-4dbf-b69d-f15ab1aabf00 req-6e996e75-aaf6-4c8f-a707-dc2638a927b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029719 Jan 10 11:41:05.326778 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 317/641] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:41:05.335488 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-dbdba8bc-5887-4e9a-bf91-a266f37d2778 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:05.336195 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-dbdba8bc-5887-4e9a-bf91-a266f37d2778 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:05.342826 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dbdba8bc-5887-4e9a-bf91-a266f37d2778 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:05.345379 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dbdba8bc-5887-4e9a-bf91-a266f37d2778 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:05.345379 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dbdba8bc-5887-4e9a-bf91-a266f37d2778 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:05.345379 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dbdba8bc-5887-4e9a-bf91-a266f37d2778 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:05.412030 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-dbdba8bc-5887-4e9a-bf91-a266f37d2778 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:05.422574 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-dbdba8bc-5887-4e9a-bf91-a266f37d2778 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1470 microversion: 2.1 time: 0.090664 Jan 10 11:41:05.423167 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 325/642] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:05 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1470 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:06.440920 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-bd117c79-88ab-4bac-bacc-27e1685451b8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:06.441634 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-bd117c79-88ab-4bac-bacc-27e1685451b8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:06.448391 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bd117c79-88ab-4bac-bacc-27e1685451b8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:06.448836 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bd117c79-88ab-4bac-bacc-27e1685451b8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:06.449612 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bd117c79-88ab-4bac-bacc-27e1685451b8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:06.450040 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bd117c79-88ab-4bac-bacc-27e1685451b8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:06.513088 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-bd117c79-88ab-4bac-bacc-27e1685451b8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:06.521040 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-bd117c79-88ab-4bac-bacc-27e1685451b8 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1470 microversion: 2.1 time: 0.084488 Jan 10 11:41:06.521646 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 318/643] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:06 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1470 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:07.541684 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2f88c680-f9ca-4894-9b4c-85c7dac9fdc5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:07.542535 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2f88c680-f9ca-4894-9b4c-85c7dac9fdc5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:07.549375 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2f88c680-f9ca-4894-9b4c-85c7dac9fdc5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:07.550077 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2f88c680-f9ca-4894-9b4c-85c7dac9fdc5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:07.550903 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2f88c680-f9ca-4894-9b4c-85c7dac9fdc5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:07.551333 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2f88c680-f9ca-4894-9b4c-85c7dac9fdc5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:07.610011 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2f88c680-f9ca-4894-9b4c-85c7dac9fdc5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:07.618015 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2f88c680-f9ca-4894-9b4c-85c7dac9fdc5 tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1302 microversion: 2.1 time: 0.082160 Jan 10 11:41:07.618697 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 326/644] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:07 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1302 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:08.635524 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f3541eea-2fb7-4056-ac94-fc4bddf04a5c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:08.636109 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f3541eea-2fb7-4056-ac94-fc4bddf04a5c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:08.643657 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f3541eea-2fb7-4056-ac94-fc4bddf04a5c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:08.644264 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f3541eea-2fb7-4056-ac94-fc4bddf04a5c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:08.645286 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f3541eea-2fb7-4056-ac94-fc4bddf04a5c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:08.645720 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f3541eea-2fb7-4056-ac94-fc4bddf04a5c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:08.688773 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f3541eea-2fb7-4056-ac94-fc4bddf04a5c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:08.689238 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f3541eea-2fb7-4056-ac94-fc4bddf04a5c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:08.689860 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-f3541eea-2fb7-4056-ac94-fc4bddf04a5c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lazy-loading 'fault' on Instance uuid 17641f31-456c-4c0f-8f40-5337b16bc6e0 {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:41:08.735634 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-f3541eea-2fb7-4056-ac94-fc4bddf04a5c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6431c85b6c74608aae42e0e856d1a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c300abbfb3b48dab6c40f20c7eb9cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:08.744952 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f3541eea-2fb7-4056-ac94-fc4bddf04a5c tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 200 len: 1307 microversion: 2.1 time: 0.113781 Jan 10 11:41:08.754357 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 319/645] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:08 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 1307 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:08.768929 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-97edccc7-a663-4ba7-9b13-966bf95209fd tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:08.769816 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-97edccc7-a663-4ba7-9b13-966bf95209fd tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:08.779803 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-97edccc7-a663-4ba7-9b13-966bf95209fd tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:08.785342 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-97edccc7-a663-4ba7-9b13-966bf95209fd tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:08.785726 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-97edccc7-a663-4ba7-9b13-966bf95209fd tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:08.786174 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-97edccc7-a663-4ba7-9b13-966bf95209fd tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:08.901174 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.objects.instance [None req-97edccc7-a663-4ba7-9b13-966bf95209fd tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lazy-loading 'services' on Instance uuid de742531-93dd-4422-b11c-57c35a136f6e {{(pid=128718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:41:09.157733 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-97edccc7-a663-4ba7-9b13-966bf95209fd tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "DELETE /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/os-volume_attachments/39a5a926-83bd-46b2-9abb-059ad0b99447" status: 202 len: 0 microversion: 2.1 time: 0.406368 Jan 10 11:41:09.157733 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 327/646] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jan 10 11:41:08 2022] DELETE /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/os-volume_attachments/39a5a926-83bd-46b2-9abb-059ad0b99447 => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:41:09.765214 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-65af226e-3345-4a9d-ad68-5dacc718a93b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:09.766025 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-65af226e-3345-4a9d-ad68-5dacc718a93b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] [instance: 17641f31-456c-4c0f-8f40-5337b16bc6e0] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:09.773197 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-65af226e-3345-4a9d-ad68-5dacc718a93b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:09.773717 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-65af226e-3345-4a9d-ad68-5dacc718a93b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:09.774542 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-65af226e-3345-4a9d-ad68-5dacc718a93b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:09.775105 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-65af226e-3345-4a9d-ad68-5dacc718a93b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:09.791402 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-65af226e-3345-4a9d-ad68-5dacc718a93b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] HTTP exception thrown: Instance 17641f31-456c-4c0f-8f40-5337b16bc6e0 could not be found. Jan 10 11:41:09.792098 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-65af226e-3345-4a9d-ad68-5dacc718a93b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] Returning 404 to user: Instance 17641f31-456c-4c0f-8f40-5337b16bc6e0 could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:41:09.792991 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-65af226e-3345-4a9d-ad68-5dacc718a93b tempest-AttachVolumeNegativeTest-1120006716 tempest-AttachVolumeNegativeTest-1120006716-project] 10.222.0.20 "GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0" status: 404 len: 111 microversion: 2.1 time: 0.031943 Jan 10 11:41:09.793563 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 320/647] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:09 2022] GET /compute/v2.1/servers/17641f31-456c-4c0f-8f40-5337b16bc6e0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:41:20.939409 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ea6f539f-0f84-4774-81a3-246ade9053a9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:41:20.939409 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ea6f539f-0f84-4774-81a3-246ade9053a9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:20.939409 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ea6f539f-0f84-4774-81a3-246ade9053a9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:20.967571 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ea6f539f-0f84-4774-81a3-246ade9053a9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Going to try to stop instance {{(pid=128718) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 10 11:41:21.186736 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ea6f539f-0f84-4774-81a3-246ade9053a9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 202 len: 0 microversion: 2.1 time: 0.259279 Jan 10 11:41:21.187803 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 328/648] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:41:20 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:41:21.202647 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-752c8452-d5e3-424b-9f03-aa9aa6967f90 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:21.203254 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-752c8452-d5e3-424b-9f03-aa9aa6967f90 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:21.209689 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-752c8452-d5e3-424b-9f03-aa9aa6967f90 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:21.210181 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-752c8452-d5e3-424b-9f03-aa9aa6967f90 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:21.211163 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-752c8452-d5e3-424b-9f03-aa9aa6967f90 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:21.211610 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-752c8452-d5e3-424b-9f03-aa9aa6967f90 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:21.351395 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-752c8452-d5e3-424b-9f03-aa9aa6967f90 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:21.359749 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-752c8452-d5e3-424b-9f03-aa9aa6967f90 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1676 microversion: 2.1 time: 0.162252 Jan 10 11:41:21.360325 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 321/649] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:21 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:22.379332 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0a61f918-42db-4391-82aa-4fcb8c7502e6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:22.380145 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0a61f918-42db-4391-82aa-4fcb8c7502e6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:22.386469 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0a61f918-42db-4391-82aa-4fcb8c7502e6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:22.386924 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0a61f918-42db-4391-82aa-4fcb8c7502e6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:22.387741 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0a61f918-42db-4391-82aa-4fcb8c7502e6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:22.388361 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0a61f918-42db-4391-82aa-4fcb8c7502e6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:22.527580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0a61f918-42db-4391-82aa-4fcb8c7502e6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:22.535361 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0a61f918-42db-4391-82aa-4fcb8c7502e6 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1676 microversion: 2.1 time: 0.160807 Jan 10 11:41:22.535933 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 329/650] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:22 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:23.552808 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a0e60c94-0301-4ad3-8397-6ee405e8d9ec tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:23.553501 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a0e60c94-0301-4ad3-8397-6ee405e8d9ec tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:23.563351 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a0e60c94-0301-4ad3-8397-6ee405e8d9ec tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:23.563351 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a0e60c94-0301-4ad3-8397-6ee405e8d9ec tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:23.563351 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a0e60c94-0301-4ad3-8397-6ee405e8d9ec tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:23.563351 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a0e60c94-0301-4ad3-8397-6ee405e8d9ec tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:24.009174 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a0e60c94-0301-4ad3-8397-6ee405e8d9ec tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:24.033490 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a0e60c94-0301-4ad3-8397-6ee405e8d9ec tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1676 microversion: 2.1 time: 0.482473 Jan 10 11:41:24.033490 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 322/651] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:23 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1676 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:25.050024 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f9fd9422-497e-4738-ae84-891a817ae1f5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:25.051410 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f9fd9422-497e-4738-ae84-891a817ae1f5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:25.070243 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f9fd9422-497e-4738-ae84-891a817ae1f5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:25.070952 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f9fd9422-497e-4738-ae84-891a817ae1f5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:25.080025 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f9fd9422-497e-4738-ae84-891a817ae1f5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:25.080549 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f9fd9422-497e-4738-ae84-891a817ae1f5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:25.249751 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f9fd9422-497e-4738-ae84-891a817ae1f5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:25.257478 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f9fd9422-497e-4738-ae84-891a817ae1f5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1676 microversion: 2.1 time: 0.212419 Jan 10 11:41:25.260480 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 330/652] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:25 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1676 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:26.275195 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2e633b91-53bc-4a78-835c-bb2f649d3d35 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:26.278637 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2e633b91-53bc-4a78-835c-bb2f649d3d35 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:26.286241 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e633b91-53bc-4a78-835c-bb2f649d3d35 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:26.286731 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e633b91-53bc-4a78-835c-bb2f649d3d35 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:26.287642 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e633b91-53bc-4a78-835c-bb2f649d3d35 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:26.288104 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e633b91-53bc-4a78-835c-bb2f649d3d35 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:26.429702 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2e633b91-53bc-4a78-835c-bb2f649d3d35 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:26.438002 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2e633b91-53bc-4a78-835c-bb2f649d3d35 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1676 microversion: 2.1 time: 0.166558 Jan 10 11:41:26.448396 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 323/653] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:26 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:27.455489 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f5e8d681-8ba2-4272-825e-a49cd2dc8774 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:27.456097 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f5e8d681-8ba2-4272-825e-a49cd2dc8774 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:27.466196 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f5e8d681-8ba2-4272-825e-a49cd2dc8774 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:27.466196 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f5e8d681-8ba2-4272-825e-a49cd2dc8774 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:27.466196 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f5e8d681-8ba2-4272-825e-a49cd2dc8774 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:27.466196 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f5e8d681-8ba2-4272-825e-a49cd2dc8774 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:27.614561 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f5e8d681-8ba2-4272-825e-a49cd2dc8774 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:27.624910 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f5e8d681-8ba2-4272-825e-a49cd2dc8774 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1676 microversion: 2.1 time: 0.172915 Jan 10 11:41:27.625494 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 331/654] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:27 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:28.643827 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-48f43c17-5e4e-46fa-b0e3-7f7436c06ef7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:28.644456 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-48f43c17-5e4e-46fa-b0e3-7f7436c06ef7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:28.651651 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-48f43c17-5e4e-46fa-b0e3-7f7436c06ef7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:28.652112 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-48f43c17-5e4e-46fa-b0e3-7f7436c06ef7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:28.652875 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-48f43c17-5e4e-46fa-b0e3-7f7436c06ef7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:28.653313 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-48f43c17-5e4e-46fa-b0e3-7f7436c06ef7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:28.791134 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-48f43c17-5e4e-46fa-b0e3-7f7436c06ef7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:28.799274 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-48f43c17-5e4e-46fa-b0e3-7f7436c06ef7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1676 microversion: 2.1 time: 0.159089 Jan 10 11:41:28.799854 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 324/655] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:28 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:29.823729 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3ceb2e0f-4329-4032-9e66-4e4245062deb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:29.825380 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3ceb2e0f-4329-4032-9e66-4e4245062deb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:29.838168 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3ceb2e0f-4329-4032-9e66-4e4245062deb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:29.847399 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3ceb2e0f-4329-4032-9e66-4e4245062deb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:29.848632 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3ceb2e0f-4329-4032-9e66-4e4245062deb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:29.849442 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3ceb2e0f-4329-4032-9e66-4e4245062deb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:30.101886 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3ceb2e0f-4329-4032-9e66-4e4245062deb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:30.136338 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3ceb2e0f-4329-4032-9e66-4e4245062deb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1676 microversion: 2.1 time: 0.316135 Jan 10 11:41:30.136558 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 332/656] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:29 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1676 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:31.156914 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7438f983-1e5e-4967-958b-05cc02e19bf9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:31.157643 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7438f983-1e5e-4967-958b-05cc02e19bf9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:31.167225 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7438f983-1e5e-4967-958b-05cc02e19bf9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:31.168301 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7438f983-1e5e-4967-958b-05cc02e19bf9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:31.169129 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7438f983-1e5e-4967-958b-05cc02e19bf9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:31.170011 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7438f983-1e5e-4967-958b-05cc02e19bf9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:31.339500 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-7438f983-1e5e-4967-958b-05cc02e19bf9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:31.347548 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7438f983-1e5e-4967-958b-05cc02e19bf9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1676 microversion: 2.1 time: 0.198267 Jan 10 11:41:31.348128 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 325/657] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:31 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1676 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:32.264278 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-d7392a3e-d562-4d92-9dd5-552653a8a817 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:32.264928 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-d7392a3e-d562-4d92-9dd5-552653a8a817 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:32.271197 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d7392a3e-d562-4d92-9dd5-552653a8a817 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:32.271653 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d7392a3e-d562-4d92-9dd5-552653a8a817 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:32.272451 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d7392a3e-d562-4d92-9dd5-552653a8a817 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:32.272894 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d7392a3e-d562-4d92-9dd5-552653a8a817 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:32.310979 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-d7392a3e-d562-4d92-9dd5-552653a8a817 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/os-volume_attachments/3e304fea-a2c0-4003-b92d-1fd930b69614" status: 200 len: 194 microversion: 2.20 time: 0.051275 Jan 10 11:41:32.311567 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 333/658] 10.222.0.20 () {60 vars in 1453 bytes} [Mon Jan 10 11:41:32 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/os-volume_attachments/3e304fea-a2c0-4003-b92d-1fd930b69614 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:41:32.366713 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-8478f593-442c-4e35-acaa-3d19b023aa3c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:32.367576 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-8478f593-442c-4e35-acaa-3d19b023aa3c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:32.376218 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8478f593-442c-4e35-acaa-3d19b023aa3c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:32.376693 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8478f593-442c-4e35-acaa-3d19b023aa3c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:32.377730 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8478f593-442c-4e35-acaa-3d19b023aa3c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:32.378166 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8478f593-442c-4e35-acaa-3d19b023aa3c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:32.393630 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0a1fad6e-8fb1-478c-9db9-e554da0e1d94 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:32.394531 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0a1fad6e-8fb1-478c-9db9-e554da0e1d94 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:32.401522 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0a1fad6e-8fb1-478c-9db9-e554da0e1d94 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:32.402161 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0a1fad6e-8fb1-478c-9db9-e554da0e1d94 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:32.403271 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0a1fad6e-8fb1-478c-9db9-e554da0e1d94 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:32.403771 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0a1fad6e-8fb1-478c-9db9-e554da0e1d94 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:32.490175 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.objects.instance [None req-0a1fad6e-8fb1-478c-9db9-e554da0e1d94 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lazy-loading 'services' on Instance uuid bb58298d-9795-4c2b-86b6-3b17b668765f {{(pid=128718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:41:32.534585 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-8478f593-442c-4e35-acaa-3d19b023aa3c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:32.542928 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-8478f593-442c-4e35-acaa-3d19b023aa3c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1653 microversion: 2.1 time: 0.181068 Jan 10 11:41:32.554201 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 326/659] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:32 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1653 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:32.559859 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-64b95460-c7f2-4b21-a000-b96ed7aa657f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:41:32.565892 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-64b95460-c7f2-4b21-a000-b96ed7aa657f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:32.566382 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-64b95460-c7f2-4b21-a000-b96ed7aa657f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:32.590446 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-64b95460-c7f2-4b21-a000-b96ed7aa657f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Going to try to start instance {{(pid=128719) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 10 11:41:32.759494 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0a1fad6e-8fb1-478c-9db9-e554da0e1d94 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/os-volume_attachments/3e304fea-a2c0-4003-b92d-1fd930b69614" status: 202 len: 0 microversion: 2.20 time: 0.369668 Jan 10 11:41:32.760380 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 334/660] 10.222.0.20 () {60 vars in 1456 bytes} [Mon Jan 10 11:41:32 2022] DELETE /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/os-volume_attachments/3e304fea-a2c0-4003-b92d-1fd930b69614 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 10 11:41:32.770122 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ea2304c1-aa17-4244-a91e-95e13136adc0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:32.771612 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ea2304c1-aa17-4244-a91e-95e13136adc0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:32.778451 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ea2304c1-aa17-4244-a91e-95e13136adc0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:32.779015 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ea2304c1-aa17-4244-a91e-95e13136adc0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:32.779857 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ea2304c1-aa17-4244-a91e-95e13136adc0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:32.780606 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ea2304c1-aa17-4244-a91e-95e13136adc0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:32.788257 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-64b95460-c7f2-4b21-a000-b96ed7aa657f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action" status: 202 len: 0 microversion: 2.1 time: 0.232284 Jan 10 11:41:32.789005 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 327/661] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:41:32 2022] POST /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:41:32.809327 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-390acd51-a2cb-46ce-bcb9-45c0c9711362 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:32.810954 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-390acd51-a2cb-46ce-bcb9-45c0c9711362 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:32.822771 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ea2304c1-aa17-4244-a91e-95e13136adc0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056819 Jan 10 11:41:32.826348 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-390acd51-a2cb-46ce-bcb9-45c0c9711362 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:32.826628 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 335/662] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jan 10 11:41:32 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:41:32.826712 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-390acd51-a2cb-46ce-bcb9-45c0c9711362 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:32.826712 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-390acd51-a2cb-46ce-bcb9-45c0c9711362 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:32.826712 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-390acd51-a2cb-46ce-bcb9-45c0c9711362 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:33.019465 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-390acd51-a2cb-46ce-bcb9-45c0c9711362 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:33.028629 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-390acd51-a2cb-46ce-bcb9-45c0c9711362 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1662 microversion: 2.1 time: 0.230461 Jan 10 11:41:33.029670 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 328/663] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:32 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1662 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:33.836867 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a612e7c8-96bf-456c-a957-6cea24b5eff0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:33.837887 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a612e7c8-96bf-456c-a957-6cea24b5eff0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:33.844442 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a612e7c8-96bf-456c-a957-6cea24b5eff0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:33.844884 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a612e7c8-96bf-456c-a957-6cea24b5eff0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:33.845668 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a612e7c8-96bf-456c-a957-6cea24b5eff0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:33.846102 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a612e7c8-96bf-456c-a957-6cea24b5eff0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:33.880201 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a612e7c8-96bf-456c-a957-6cea24b5eff0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045884 Jan 10 11:41:33.883459 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 336/664] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jan 10 11:41:33 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:33.943183 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-797079c4-243d-4d78-86e0-a62bd4991ede tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:33.943747 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-797079c4-243d-4d78-86e0-a62bd4991ede tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:33.954322 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-797079c4-243d-4d78-86e0-a62bd4991ede tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:33.954771 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-797079c4-243d-4d78-86e0-a62bd4991ede tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:33.956008 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-797079c4-243d-4d78-86e0-a62bd4991ede tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:33.956455 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-797079c4-243d-4d78-86e0-a62bd4991ede tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:33.991019 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-797079c4-243d-4d78-86e0-a62bd4991ede tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Going to try to terminate instance {{(pid=128719) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:41:34.045972 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-6f330569-1dc8-44e8-9e76-81b50414c6a9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:34.046752 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-6f330569-1dc8-44e8-9e76-81b50414c6a9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:34.052887 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6f330569-1dc8-44e8-9e76-81b50414c6a9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:34.053345 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6f330569-1dc8-44e8-9e76-81b50414c6a9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:34.054155 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6f330569-1dc8-44e8-9e76-81b50414c6a9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:34.054645 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6f330569-1dc8-44e8-9e76-81b50414c6a9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:34.263529 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-797079c4-243d-4d78-86e0-a62bd4991ede tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 204 len: 0 microversion: 2.20 time: 0.323727 Jan 10 11:41:34.264126 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 329/665] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Jan 10 11:41:33 2022] DELETE /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 10 11:41:34.269999 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-6f330569-1dc8-44e8-9e76-81b50414c6a9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:34.277440 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-21803522-e0c3-43ca-9dc1-0664e7e70ea4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:34.278015 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-6f330569-1dc8-44e8-9e76-81b50414c6a9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1662 microversion: 2.1 time: 0.235872 Jan 10 11:41:34.278131 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-21803522-e0c3-43ca-9dc1-0664e7e70ea4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:34.278681 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 337/666] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:34 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1662 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:34.284414 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-21803522-e0c3-43ca-9dc1-0664e7e70ea4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:34.284991 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-21803522-e0c3-43ca-9dc1-0664e7e70ea4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:34.285789 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-21803522-e0c3-43ca-9dc1-0664e7e70ea4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:34.286241 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-21803522-e0c3-43ca-9dc1-0664e7e70ea4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:34.511983 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-21803522-e0c3-43ca-9dc1-0664e7e70ea4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:34.520505 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-21803522-e0c3-43ca-9dc1-0664e7e70ea4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:34.521999 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-21803522-e0c3-43ca-9dc1-0664e7e70ea4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:34.523268 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-21803522-e0c3-43ca-9dc1-0664e7e70ea4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.250155 Jan 10 11:41:34.523830 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 330/667] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:34 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:41:35.296028 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-d60114d1-43ec-45a4-b65f-844d50822ad1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:35.297729 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-d60114d1-43ec-45a4-b65f-844d50822ad1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:35.305552 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d60114d1-43ec-45a4-b65f-844d50822ad1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:35.307311 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d60114d1-43ec-45a4-b65f-844d50822ad1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:35.308232 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d60114d1-43ec-45a4-b65f-844d50822ad1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:35.308679 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d60114d1-43ec-45a4-b65f-844d50822ad1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:35.470827 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-d60114d1-43ec-45a4-b65f-844d50822ad1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:35.483125 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-d60114d1-43ec-45a4-b65f-844d50822ad1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1666 microversion: 2.1 time: 0.192177 Jan 10 11:41:35.483837 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 338/668] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:35 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1666 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:35.542315 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-25e66513-85f4-4fd6-a1be-b896df94c604 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:35.542929 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-25e66513-85f4-4fd6-a1be-b896df94c604 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:35.549461 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-25e66513-85f4-4fd6-a1be-b896df94c604 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:35.549913 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-25e66513-85f4-4fd6-a1be-b896df94c604 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:35.550734 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-25e66513-85f4-4fd6-a1be-b896df94c604 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:35.551921 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-25e66513-85f4-4fd6-a1be-b896df94c604 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:35.690613 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-25e66513-85f4-4fd6-a1be-b896df94c604 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:35.699299 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-25e66513-85f4-4fd6-a1be-b896df94c604 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:35.700792 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-25e66513-85f4-4fd6-a1be-b896df94c604 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:35.702026 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-25e66513-85f4-4fd6-a1be-b896df94c604 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1722 microversion: 2.20 time: 0.163991 Jan 10 11:41:35.702806 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 331/669] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:35 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:41:36.720084 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c1780174-8e65-41b5-85e2-710ffefa5b0c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:36.720743 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c1780174-8e65-41b5-85e2-710ffefa5b0c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:36.726981 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c1780174-8e65-41b5-85e2-710ffefa5b0c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:36.727484 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c1780174-8e65-41b5-85e2-710ffefa5b0c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:36.728346 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c1780174-8e65-41b5-85e2-710ffefa5b0c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:36.729533 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c1780174-8e65-41b5-85e2-710ffefa5b0c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:36.803029 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c1780174-8e65-41b5-85e2-710ffefa5b0c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:36.812262 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c1780174-8e65-41b5-85e2-710ffefa5b0c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:36.813885 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c1780174-8e65-41b5-85e2-710ffefa5b0c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:36.815133 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c1780174-8e65-41b5-85e2-710ffefa5b0c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1654 microversion: 2.20 time: 0.098836 Jan 10 11:41:36.818310 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 339/670] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:36 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1654 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:41:37.126017 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-6dfdc8ba-694a-4eb8-918a-9fe3e6064264 req-8b6fb75c-d1c4-4f17-b211-fabc428904c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb58298d-9795-4c2b-86b6-3b17b668765f", "name": "network-vif-deleted", "tag": "ad9b761f-8e30-4890-b16f-aceb4777ab0b"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:41:37.127623 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:41:37.127623 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:41:37.139173 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-6dfdc8ba-694a-4eb8-918a-9fe3e6064264 req-8b6fb75c-d1c4-4f17-b211-fabc428904c1 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:37.139173 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-6dfdc8ba-694a-4eb8-918a-9fe3e6064264 req-8b6fb75c-d1c4-4f17-b211-fabc428904c1 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:37.147937 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-6dfdc8ba-694a-4eb8-918a-9fe3e6064264 req-8b6fb75c-d1c4-4f17-b211-fabc428904c1 service nova] Creating event network-vif-deleted:ad9b761f-8e30-4890-b16f-aceb4777ab0b for instance bb58298d-9795-4c2b-86b6-3b17b668765f on hv-cinder-maste Jan 10 11:41:37.153453 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-6dfdc8ba-694a-4eb8-918a-9fe3e6064264 req-8b6fb75c-d1c4-4f17-b211-fabc428904c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031986 Jan 10 11:41:37.154099 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 332/671] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:41:37.342371 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0dde0242-788e-4e18-930b-d1d2c7301fd7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-876555793", "imageRef": "b6e63192-9c33-4d80-9555-6de2bb10fd32", "flavorRef": "452", "networks": [{"uuid": "ef46ac2a-9aa5-4568-beae-a9f54e14c6d0"}]}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:41:37.406699 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.network.neutron [None req-0dde0242-788e-4e18-930b-d1d2c7301fd7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] validate_networks() for [('ef46ac2a-9aa5-4568-beae-a9f54e14c6d0', None, None, None, None, None)] {{(pid=128718) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:41:37.792267 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-0dde0242-788e-4e18-930b-d1d2c7301fd7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Flavor limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:41:37.792847 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-0dde0242-788e-4e18-930b-d1d2c7301fd7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Image limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:41:37.793468 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-0dde0242-788e-4e18-930b-d1d2c7301fd7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Flavor pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:41:37.793986 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-0dde0242-788e-4e18-930b-d1d2c7301fd7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Image pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:41:37.794508 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-0dde0242-788e-4e18-930b-d1d2c7301fd7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:41:37.805484 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0dde0242-788e-4e18-930b-d1d2c7301fd7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:37.806058 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0dde0242-788e-4e18-930b-d1d2c7301fd7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:37.807794 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0dde0242-788e-4e18-930b-d1d2c7301fd7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:37.808416 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0dde0242-788e-4e18-930b-d1d2c7301fd7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:37.827182 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-0dde0242-788e-4e18-930b-d1d2c7301fd7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Getting quotas for project 0f63270caad74d2ab5a02aa80ad08ea1. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:41:37.835232 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-63b6108d-c853-4a32-b11c-c3e0e7765789 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:37.836917 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-63b6108d-c853-4a32-b11c-c3e0e7765789 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:37.837170 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-0dde0242-788e-4e18-930b-d1d2c7301fd7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Getting quotas for user 28cce52a599447de8e898b1d42801c7e and project 0f63270caad74d2ab5a02aa80ad08ea1. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:41:37.844183 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-63b6108d-c853-4a32-b11c-c3e0e7765789 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:37.844868 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-63b6108d-c853-4a32-b11c-c3e0e7765789 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:37.845665 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-63b6108d-c853-4a32-b11c-c3e0e7765789 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:37.846271 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-63b6108d-c853-4a32-b11c-c3e0e7765789 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:37.851109 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0dde0242-788e-4e18-930b-d1d2c7301fd7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Going to run 1 instances... {{(pid=128718) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:41:37.854802 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0dde0242-788e-4e18-930b-d1d2c7301fd7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e63192-9c33-4d80-9555-6de2bb10fd32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:41:37.880655 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-63b6108d-c853-4a32-b11c-c3e0e7765789 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:37.881108 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-63b6108d-c853-4a32-b11c-c3e0e7765789 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:37.881737 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-63b6108d-c853-4a32-b11c-c3e0e7765789 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lazy-loading 'fault' on Instance uuid bb58298d-9795-4c2b-86b6-3b17b668765f {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:41:37.925439 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-63b6108d-c853-4a32-b11c-c3e0e7765789 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:37.934715 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-63b6108d-c853-4a32-b11c-c3e0e7765789 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:37.936261 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-63b6108d-c853-4a32-b11c-c3e0e7765789 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:37.937418 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-63b6108d-c853-4a32-b11c-c3e0e7765789 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 200 len: 1370 microversion: 2.20 time: 0.106343 Jan 10 11:41:37.937980 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 333/672] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:37 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 1370 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:41:37.992369 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0dde0242-788e-4e18-930b-d1d2c7301fd7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653735 Jan 10 11:41:37.993659 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 340/673] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:41:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 10 11:41:38.005008 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7d6aee56-96ad-4773-aa83-d2bc6240aea8 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:38.005623 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7d6aee56-96ad-4773-aa83-d2bc6240aea8 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:38.075973 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-7d6aee56-96ad-4773-aa83-d2bc6240aea8 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:38.083922 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7d6aee56-96ad-4773-aa83-d2bc6240aea8 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1213 microversion: 2.1 time: 0.082666 Jan 10 11:41:38.084837 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 334/674] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:37 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:38.958577 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-cc3b966a-91e5-4941-9821-8fff813bacfc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:38.963325 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-cc3b966a-91e5-4941-9821-8fff813bacfc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:38.965970 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cc3b966a-91e5-4941-9821-8fff813bacfc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:38.966451 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cc3b966a-91e5-4941-9821-8fff813bacfc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:38.967239 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cc3b966a-91e5-4941-9821-8fff813bacfc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:38.967706 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cc3b966a-91e5-4941-9821-8fff813bacfc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:38.982116 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-cc3b966a-91e5-4941-9821-8fff813bacfc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] HTTP exception thrown: Instance bb58298d-9795-4c2b-86b6-3b17b668765f could not be found. Jan 10 11:41:38.982745 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-cc3b966a-91e5-4941-9821-8fff813bacfc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Returning 404 to user: Instance bb58298d-9795-4c2b-86b6-3b17b668765f could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:41:38.983583 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-cc3b966a-91e5-4941-9821-8fff813bacfc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 404 len: 111 microversion: 2.20 time: 0.029696 Jan 10 11:41:38.984142 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 341/675] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:38 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 10 11:41:38.992901 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-4def36b4-c1d5-4fd9-a616-eda60ae86f00 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '.version_select at 0x7f477a4b8b80>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:39.100919 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-19f2e6b8-3abe-441b-b040-1d1ab1e9a0da tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:39.101486 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-19f2e6b8-3abe-441b-b040-1d1ab1e9a0da tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:39.158058 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-19f2e6b8-3abe-441b-b040-1d1ab1e9a0da tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:39.161542 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-19f2e6b8-3abe-441b-b040-1d1ab1e9a0da tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1213 microversion: 2.1 time: 0.064462 Jan 10 11:41:39.162115 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 342/676] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:39 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:41:39.219529 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-4def36b4-c1d5-4fd9-a616-eda60ae86f00 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-61070925" status: 204 len: 0 microversion: 2.20 time: 0.230356 Jan 10 11:41:39.220352 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 335/677] 10.222.0.20 () {60 vars in 1255 bytes} [Mon Jan 10 11:41:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-61070925 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 10 11:41:40.179067 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-1f4b8167-fa71-44c9-8dd1-de854c6aaea1 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:40.179666 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-1f4b8167-fa71-44c9-8dd1-de854c6aaea1 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:40.187485 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1f4b8167-fa71-44c9-8dd1-de854c6aaea1 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:40.187935 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1f4b8167-fa71-44c9-8dd1-de854c6aaea1 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:40.188719 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1f4b8167-fa71-44c9-8dd1-de854c6aaea1 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:40.189147 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1f4b8167-fa71-44c9-8dd1-de854c6aaea1 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:40.256523 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2b82b697-d4fd-40a3-9d8f-21b148c846c7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'create', calling method: .version_select at 0x7f477a2f3b80>, body: {"keypair": {"name": "tempest-keypair-1577410726"}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:41:40.262242 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-1f4b8167-fa71-44c9-8dd1-de854c6aaea1 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:40.270190 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-1f4b8167-fa71-44c9-8dd1-de854c6aaea1 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1217 microversion: 2.1 time: 0.094835 Jan 10 11:41:40.270926 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 343/678] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:40 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:40.275825 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-2b82b697-d4fd-40a3-9d8f-21b148c846c7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Getting quotas for project 274889e6213c4dfaab0997e2dad420ff. Resources: {'key_pairs'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:41:40.279941 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-2b82b697-d4fd-40a3-9d8f-21b148c846c7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Getting quotas for user 2c652557dbd54165a3498c08b2dd5673 and project 274889e6213c4dfaab0997e2dad420ff. Resources: {'key_pairs'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:41:40.522176 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-2b82b697-d4fd-40a3-9d8f-21b148c846c7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Getting quotas for project 274889e6213c4dfaab0997e2dad420ff. Resources: {'key_pairs'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:41:40.526801 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-2b82b697-d4fd-40a3-9d8f-21b148c846c7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Getting quotas for user 2c652557dbd54165a3498c08b2dd5673 and project 274889e6213c4dfaab0997e2dad420ff. Resources: {'key_pairs'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:41:40.540760 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2b82b697-d4fd-40a3-9d8f-21b148c846c7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.287857 Jan 10 11:41:40.541473 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 336/679] 10.222.0.20 () {62 vars in 1198 bytes} [Mon Jan 10 11:41:40 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 289 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 10 11:41:41.287330 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b15de1c3-a8c2-4948-b3b0-86561d2d1f89 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:41.287984 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b15de1c3-a8c2-4948-b3b0-86561d2d1f89 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:41.295275 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b15de1c3-a8c2-4948-b3b0-86561d2d1f89 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:41.295729 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b15de1c3-a8c2-4948-b3b0-86561d2d1f89 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:41.296527 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b15de1c3-a8c2-4948-b3b0-86561d2d1f89 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:41.296964 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b15de1c3-a8c2-4948-b3b0-86561d2d1f89 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:41.357424 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b15de1c3-a8c2-4948-b3b0-86561d2d1f89 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:41.365393 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b15de1c3-a8c2-4948-b3b0-86561d2d1f89 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1217 microversion: 2.1 time: 0.081837 Jan 10 11:41:41.365978 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 344/680] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:41 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:42.383177 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-09d600be-3ad5-495c-8e4f-dbac7ec07691 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:42.383951 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-09d600be-3ad5-495c-8e4f-dbac7ec07691 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:42.391076 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-09d600be-3ad5-495c-8e4f-dbac7ec07691 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:42.391523 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-09d600be-3ad5-495c-8e4f-dbac7ec07691 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:42.392543 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-09d600be-3ad5-495c-8e4f-dbac7ec07691 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:42.393006 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-09d600be-3ad5-495c-8e4f-dbac7ec07691 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:42.456077 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-09d600be-3ad5-495c-8e4f-dbac7ec07691 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:42.464189 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-09d600be-3ad5-495c-8e4f-dbac7ec07691 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1265 microversion: 2.1 time: 0.084842 Jan 10 11:41:42.464753 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 337/681] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:42 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:43.061849 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8e3aa51a-1ffd-4a66-8121-766e6f07dbb9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-890100615", "imageRef": "b6e63192-9c33-4d80-9555-6de2bb10fd32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05ffc7ce-f421-4ef2-baa4-3ee4a31019b2"}], "security_groups": [{"name": "tempest-securitygroup--1493004738"}], "key_name": "tempest-keypair-1577410726", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:41:43.174812 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.network.neutron [None req-8e3aa51a-1ffd-4a66-8121-766e6f07dbb9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] validate_networks() for [('05ffc7ce-f421-4ef2-baa4-3ee4a31019b2', None, None, None, None, None)] {{(pid=128718) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:41:43.481811 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-05505a08-ef1d-4fd4-ad6c-c79ff1c84ea2 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:43.482650 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-05505a08-ef1d-4fd4-ad6c-c79ff1c84ea2 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:43.489409 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-05505a08-ef1d-4fd4-ad6c-c79ff1c84ea2 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:43.489882 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-05505a08-ef1d-4fd4-ad6c-c79ff1c84ea2 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:43.490712 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-05505a08-ef1d-4fd4-ad6c-c79ff1c84ea2 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:43.491149 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-05505a08-ef1d-4fd4-ad6c-c79ff1c84ea2 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:43.631191 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-8e3aa51a-1ffd-4a66-8121-766e6f07dbb9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Flavor limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:41:43.631699 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-8e3aa51a-1ffd-4a66-8121-766e6f07dbb9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Image limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:41:43.632334 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-8e3aa51a-1ffd-4a66-8121-766e6f07dbb9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Flavor pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:41:43.632923 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-8e3aa51a-1ffd-4a66-8121-766e6f07dbb9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Image pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:41:43.633500 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-8e3aa51a-1ffd-4a66-8121-766e6f07dbb9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:41:43.643580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8e3aa51a-1ffd-4a66-8121-766e6f07dbb9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:43.644035 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8e3aa51a-1ffd-4a66-8121-766e6f07dbb9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:43.644855 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8e3aa51a-1ffd-4a66-8121-766e6f07dbb9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:43.645297 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8e3aa51a-1ffd-4a66-8121-766e6f07dbb9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:43.668878 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-8e3aa51a-1ffd-4a66-8121-766e6f07dbb9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Getting quotas for project 274889e6213c4dfaab0997e2dad420ff. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:41:43.672886 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-8e3aa51a-1ffd-4a66-8121-766e6f07dbb9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Getting quotas for user 2c652557dbd54165a3498c08b2dd5673 and project 274889e6213c4dfaab0997e2dad420ff. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:41:43.683902 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-8e3aa51a-1ffd-4a66-8121-766e6f07dbb9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Going to run 1 instances... {{(pid=128718) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:41:43.686260 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-8e3aa51a-1ffd-4a66-8121-766e6f07dbb9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e63192-9c33-4d80-9555-6de2bb10fd32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:41:43.691216 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-05505a08-ef1d-4fd4-ad6c-c79ff1c84ea2 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:43.700720 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-05505a08-ef1d-4fd4-ad6c-c79ff1c84ea2 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1313 microversion: 2.1 time: 0.223190 Jan 10 11:41:43.701870 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 338/682] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:43 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:41:43.807755 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-8e3aa51a-1ffd-4a66-8121-766e6f07dbb9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.754132 Jan 10 11:41:43.808537 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 345/683] 10.222.0.20 () {62 vars in 1187 bytes} [Mon Jan 10 11:41:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 10 11:41:43.818253 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-4fc29c4a-7126-4028-ab94-8ba93a3abd9c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:43.818941 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-4fc29c4a-7126-4028-ab94-8ba93a3abd9c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:43.872967 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-4fc29c4a-7126-4028-ab94-8ba93a3abd9c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:43.880282 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-4fc29c4a-7126-4028-ab94-8ba93a3abd9c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:43.881839 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-4fc29c4a-7126-4028-ab94-8ba93a3abd9c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:43.883019 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-4fc29c4a-7126-4028-ab94-8ba93a3abd9c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1281 microversion: 2.20 time: 0.068461 Jan 10 11:41:43.883622 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 339/684] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:43 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:41:44.719341 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c98825c4-3e8d-4043-910a-f0abd96147c5 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:44.719943 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c98825c4-3e8d-4043-910a-f0abd96147c5 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:44.725993 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c98825c4-3e8d-4043-910a-f0abd96147c5 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:44.726470 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c98825c4-3e8d-4043-910a-f0abd96147c5 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:44.727252 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c98825c4-3e8d-4043-910a-f0abd96147c5 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:44.727688 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c98825c4-3e8d-4043-910a-f0abd96147c5 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:44.867493 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c98825c4-3e8d-4043-910a-f0abd96147c5 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:44.875093 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c98825c4-3e8d-4043-910a-f0abd96147c5 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1313 microversion: 2.1 time: 0.159961 Jan 10 11:41:44.875675 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 346/685] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:44 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:44.901504 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-da17840f-9f87-4d7a-9d67-df69b611e682 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:44.903002 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-da17840f-9f87-4d7a-9d67-df69b611e682 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:44.909451 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-da17840f-9f87-4d7a-9d67-df69b611e682 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:44.909906 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-da17840f-9f87-4d7a-9d67-df69b611e682 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:44.910729 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-da17840f-9f87-4d7a-9d67-df69b611e682 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:44.911173 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-da17840f-9f87-4d7a-9d67-df69b611e682 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:44.971876 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-da17840f-9f87-4d7a-9d67-df69b611e682 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:44.980070 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-da17840f-9f87-4d7a-9d67-df69b611e682 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:44.981592 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-da17840f-9f87-4d7a-9d67-df69b611e682 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:44.982724 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-da17840f-9f87-4d7a-9d67-df69b611e682 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1285 microversion: 2.20 time: 0.085822 Jan 10 11:41:44.983286 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 340/686] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:44 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:41:45.892368 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-fd562cb8-f13d-401c-aac8-7bb28a78487c tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:45.892978 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-fd562cb8-f13d-401c-aac8-7bb28a78487c tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:45.899471 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fd562cb8-f13d-401c-aac8-7bb28a78487c tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:45.899987 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fd562cb8-f13d-401c-aac8-7bb28a78487c tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:45.901498 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fd562cb8-f13d-401c-aac8-7bb28a78487c tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:45.901958 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fd562cb8-f13d-401c-aac8-7bb28a78487c tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:46.001118 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-22d4dc91-7504-4477-b444-fc6d46c34491 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:46.001955 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-22d4dc91-7504-4477-b444-fc6d46c34491 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:46.008697 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-22d4dc91-7504-4477-b444-fc6d46c34491 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:46.009246 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-22d4dc91-7504-4477-b444-fc6d46c34491 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:46.011102 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-22d4dc91-7504-4477-b444-fc6d46c34491 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:46.011624 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-22d4dc91-7504-4477-b444-fc6d46c34491 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:46.039277 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-fd562cb8-f13d-401c-aac8-7bb28a78487c tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:46.046567 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-fd562cb8-f13d-401c-aac8-7bb28a78487c tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1313 microversion: 2.1 time: 0.158173 Jan 10 11:41:46.047140 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 347/687] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:45 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:46.083057 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-22d4dc91-7504-4477-b444-fc6d46c34491 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:46.092195 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-22d4dc91-7504-4477-b444-fc6d46c34491 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:46.093735 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-22d4dc91-7504-4477-b444-fc6d46c34491 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:46.094870 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-22d4dc91-7504-4477-b444-fc6d46c34491 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1285 microversion: 2.20 time: 0.097532 Jan 10 11:41:46.095421 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 341/688] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:45 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:41:46.238434 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-62698d25-d6f2-4054-a2e9-a47c464a8d18 req-e42d3907-3ab6-476a-9bbe-673b8b5e82a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064", "tag": "8ab8d3f6-83e5-470a-8aeb-12a8eb8223cd"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:41:46.240073 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:41:46.240073 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:41:46.247974 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-62698d25-d6f2-4054-a2e9-a47c464a8d18 req-e42d3907-3ab6-476a-9bbe-673b8b5e82a1 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:46.248423 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-62698d25-d6f2-4054-a2e9-a47c464a8d18 req-e42d3907-3ab6-476a-9bbe-673b8b5e82a1 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:46.259460 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-62698d25-d6f2-4054-a2e9-a47c464a8d18 req-e42d3907-3ab6-476a-9bbe-673b8b5e82a1 service nova] Creating event network-changed:8ab8d3f6-83e5-470a-8aeb-12a8eb8223cd for instance 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 on hv-cinder-maste Jan 10 11:41:46.264872 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-62698d25-d6f2-4054-a2e9-a47c464a8d18 req-e42d3907-3ab6-476a-9bbe-673b8b5e82a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030730 Jan 10 11:41:46.265473 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 348/689] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:41:47.063767 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3343db95-adf9-46b6-8a92-eb100a01df67 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:47.064569 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-3343db95-adf9-46b6-8a92-eb100a01df67 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:47.072054 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3343db95-adf9-46b6-8a92-eb100a01df67 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:47.072194 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3343db95-adf9-46b6-8a92-eb100a01df67 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:47.074323 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3343db95-adf9-46b6-8a92-eb100a01df67 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:47.074946 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3343db95-adf9-46b6-8a92-eb100a01df67 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:47.116100 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-5c28ffcc-486a-48eb-887c-536392195854 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:47.117216 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-5c28ffcc-486a-48eb-887c-536392195854 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:47.129013 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5c28ffcc-486a-48eb-887c-536392195854 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:47.129936 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5c28ffcc-486a-48eb-887c-536392195854 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:47.131454 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5c28ffcc-486a-48eb-887c-536392195854 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:47.132391 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5c28ffcc-486a-48eb-887c-536392195854 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:47.215902 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-5c28ffcc-486a-48eb-887c-536392195854 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:47.224501 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-5c28ffcc-486a-48eb-887c-536392195854 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:47.225948 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-5c28ffcc-486a-48eb-887c-536392195854 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:47.227123 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-5c28ffcc-486a-48eb-887c-536392195854 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1333 microversion: 2.20 time: 0.117225 Jan 10 11:41:47.227696 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 349/690] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:47 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1333 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:41:47.253105 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-3343db95-adf9-46b6-8a92-eb100a01df67 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:47.261657 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3343db95-adf9-46b6-8a92-eb100a01df67 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1313 microversion: 2.1 time: 0.202099 Jan 10 11:41:47.262281 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 342/691] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:47 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:41:48.246030 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-749b91e4-e557-49bb-9678-2a66630eaa90 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:48.246839 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-749b91e4-e557-49bb-9678-2a66630eaa90 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:48.253729 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-749b91e4-e557-49bb-9678-2a66630eaa90 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:48.257603 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-749b91e4-e557-49bb-9678-2a66630eaa90 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:48.257603 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-749b91e4-e557-49bb-9678-2a66630eaa90 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:48.257603 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-749b91e4-e557-49bb-9678-2a66630eaa90 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:48.279710 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b9bc01ea-dea6-4cf7-a3ea-a914726b40c1 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:48.280692 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b9bc01ea-dea6-4cf7-a3ea-a914726b40c1 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:48.287592 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b9bc01ea-dea6-4cf7-a3ea-a914726b40c1 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:48.288141 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b9bc01ea-dea6-4cf7-a3ea-a914726b40c1 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:48.289389 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b9bc01ea-dea6-4cf7-a3ea-a914726b40c1 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:48.290065 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b9bc01ea-dea6-4cf7-a3ea-a914726b40c1 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:48.322738 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-749b91e4-e557-49bb-9678-2a66630eaa90 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:48.332173 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-749b91e4-e557-49bb-9678-2a66630eaa90 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:48.333437 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-749b91e4-e557-49bb-9678-2a66630eaa90 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:48.334587 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-749b91e4-e557-49bb-9678-2a66630eaa90 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1351 microversion: 2.20 time: 0.093346 Jan 10 11:41:48.346076 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 350/692] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:48 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:41:48.433157 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-b9bc01ea-dea6-4cf7-a3ea-a914726b40c1 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:48.441096 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b9bc01ea-dea6-4cf7-a3ea-a914726b40c1 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1313 microversion: 2.1 time: 0.166414 Jan 10 11:41:48.441683 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 343/693] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:48 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:49.352802 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8c263759-30eb-42ad-ae3b-21a62485dbf9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:49.353527 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-8c263759-30eb-42ad-ae3b-21a62485dbf9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:49.361033 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8c263759-30eb-42ad-ae3b-21a62485dbf9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:49.361490 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8c263759-30eb-42ad-ae3b-21a62485dbf9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:49.362305 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8c263759-30eb-42ad-ae3b-21a62485dbf9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:49.362753 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8c263759-30eb-42ad-ae3b-21a62485dbf9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:49.457835 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-985c6d5a-2961-4e2e-9ec8-7e1a69c3caa3 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:49.458467 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-985c6d5a-2961-4e2e-9ec8-7e1a69c3caa3 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:49.465411 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-985c6d5a-2961-4e2e-9ec8-7e1a69c3caa3 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:49.465868 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-985c6d5a-2961-4e2e-9ec8-7e1a69c3caa3 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:49.466732 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-985c6d5a-2961-4e2e-9ec8-7e1a69c3caa3 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:49.467179 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-985c6d5a-2961-4e2e-9ec8-7e1a69c3caa3 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:49.530852 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-8c263759-30eb-42ad-ae3b-21a62485dbf9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:49.539046 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-8c263759-30eb-42ad-ae3b-21a62485dbf9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:49.540678 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-8c263759-30eb-42ad-ae3b-21a62485dbf9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:49.542625 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-8c263759-30eb-42ad-ae3b-21a62485dbf9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1407 microversion: 2.20 time: 0.193285 Jan 10 11:41:49.543199 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 351/694] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:49 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:41:49.630714 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-985c6d5a-2961-4e2e-9ec8-7e1a69c3caa3 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:49.640646 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-985c6d5a-2961-4e2e-9ec8-7e1a69c3caa3 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1313 microversion: 2.1 time: 0.186336 Jan 10 11:41:49.641432 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 344/695] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:49 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:41:50.562628 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-9ec74c98-a691-427b-8c45-32a67a366671 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:50.563670 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-9ec74c98-a691-427b-8c45-32a67a366671 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:50.572380 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9ec74c98-a691-427b-8c45-32a67a366671 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:50.573645 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9ec74c98-a691-427b-8c45-32a67a366671 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:50.574938 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9ec74c98-a691-427b-8c45-32a67a366671 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:50.575642 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9ec74c98-a691-427b-8c45-32a67a366671 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:50.660261 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e0e51363-4de1-48c3-a6f5-5cfbfd8f3021 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:50.662075 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-e0e51363-4de1-48c3-a6f5-5cfbfd8f3021 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:50.681448 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e0e51363-4de1-48c3-a6f5-5cfbfd8f3021 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:50.682812 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e0e51363-4de1-48c3-a6f5-5cfbfd8f3021 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:50.684917 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e0e51363-4de1-48c3-a6f5-5cfbfd8f3021 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:50.685406 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e0e51363-4de1-48c3-a6f5-5cfbfd8f3021 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:50.780667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-9ec74c98-a691-427b-8c45-32a67a366671 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:50.789425 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-9ec74c98-a691-427b-8c45-32a67a366671 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:50.791001 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-9ec74c98-a691-427b-8c45-32a67a366671 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:50.792793 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-9ec74c98-a691-427b-8c45-32a67a366671 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1407 microversion: 2.20 time: 0.236044 Jan 10 11:41:50.793361 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 352/696] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:50 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:41:50.873153 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-e0e51363-4de1-48c3-a6f5-5cfbfd8f3021 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:50.892534 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-e0e51363-4de1-48c3-a6f5-5cfbfd8f3021 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1313 microversion: 2.1 time: 0.226117 Jan 10 11:41:50.892534 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 345/697] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:50 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:51.174851 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-8c0941ec-4d08-4d40-a648-286e7dc4bf90 req-15e02e82-cb6c-4d75-9b32-1bcf11b3b6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70029374-0ab3-49b9-880e-6a102761c463", "tag": "5d53e751-c135-4aa3-b56f-602088936cc0"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:41:51.177063 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:41:51.177063 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:41:51.185189 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-8c0941ec-4d08-4d40-a648-286e7dc4bf90 req-15e02e82-cb6c-4d75-9b32-1bcf11b3b6b4 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:51.185866 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-8c0941ec-4d08-4d40-a648-286e7dc4bf90 req-15e02e82-cb6c-4d75-9b32-1bcf11b3b6b4 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:51.199742 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-8c0941ec-4d08-4d40-a648-286e7dc4bf90 req-15e02e82-cb6c-4d75-9b32-1bcf11b3b6b4 service nova] Creating event network-changed:5d53e751-c135-4aa3-b56f-602088936cc0 for instance 70029374-0ab3-49b9-880e-6a102761c463 on hv-cinder-maste Jan 10 11:41:51.206113 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-8c0941ec-4d08-4d40-a648-286e7dc4bf90 req-15e02e82-cb6c-4d75-9b32-1bcf11b3b6b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035118 Jan 10 11:41:51.206764 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 353/698] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:41:51.810609 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2338d828-c602-4fcb-83c3-134a22b3e587 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:51.811358 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2338d828-c602-4fcb-83c3-134a22b3e587 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:51.818314 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2338d828-c602-4fcb-83c3-134a22b3e587 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:51.818771 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2338d828-c602-4fcb-83c3-134a22b3e587 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:51.819576 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2338d828-c602-4fcb-83c3-134a22b3e587 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:51.820006 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2338d828-c602-4fcb-83c3-134a22b3e587 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:51.903693 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a7c4fe1d-80d8-4968-8cb4-7c63b7524c2a tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:51.905019 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a7c4fe1d-80d8-4968-8cb4-7c63b7524c2a tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:51.912870 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a7c4fe1d-80d8-4968-8cb4-7c63b7524c2a tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:51.913325 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a7c4fe1d-80d8-4968-8cb4-7c63b7524c2a tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:51.914134 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a7c4fe1d-80d8-4968-8cb4-7c63b7524c2a tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:51.914788 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a7c4fe1d-80d8-4968-8cb4-7c63b7524c2a tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:51.975319 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2338d828-c602-4fcb-83c3-134a22b3e587 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:51.984625 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2338d828-c602-4fcb-83c3-134a22b3e587 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:51.987009 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2338d828-c602-4fcb-83c3-134a22b3e587 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:51.988263 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2338d828-c602-4fcb-83c3-134a22b3e587 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1407 microversion: 2.20 time: 0.182339 Jan 10 11:41:51.989340 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 346/699] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:51 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:41:52.063251 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-a7c4fe1d-80d8-4968-8cb4-7c63b7524c2a tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:52.072404 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a7c4fe1d-80d8-4968-8cb4-7c63b7524c2a tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1313 microversion: 2.1 time: 0.171932 Jan 10 11:41:52.072404 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 354/700] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:51 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:41:53.011723 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9247bfff-7f53-46fc-9f18-80c0b85fee53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:53.012332 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9247bfff-7f53-46fc-9f18-80c0b85fee53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:53.018797 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9247bfff-7f53-46fc-9f18-80c0b85fee53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:53.021012 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9247bfff-7f53-46fc-9f18-80c0b85fee53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:53.021012 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9247bfff-7f53-46fc-9f18-80c0b85fee53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:53.021012 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9247bfff-7f53-46fc-9f18-80c0b85fee53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:53.089608 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-77269781-8bb5-49f0-91dc-d457e16ec0c3 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:53.090420 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-77269781-8bb5-49f0-91dc-d457e16ec0c3 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:53.099010 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-77269781-8bb5-49f0-91dc-d457e16ec0c3 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:53.099734 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-77269781-8bb5-49f0-91dc-d457e16ec0c3 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:53.100591 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-77269781-8bb5-49f0-91dc-d457e16ec0c3 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:53.101595 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-77269781-8bb5-49f0-91dc-d457e16ec0c3 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:53.186390 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9247bfff-7f53-46fc-9f18-80c0b85fee53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:53.194305 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9247bfff-7f53-46fc-9f18-80c0b85fee53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:53.195829 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9247bfff-7f53-46fc-9f18-80c0b85fee53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:53.196939 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9247bfff-7f53-46fc-9f18-80c0b85fee53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1407 microversion: 2.20 time: 0.189891 Jan 10 11:41:53.197496 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 347/701] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:53 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:41:53.257326 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-77269781-8bb5-49f0-91dc-d457e16ec0c3 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:53.265316 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-77269781-8bb5-49f0-91dc-d457e16ec0c3 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1313 microversion: 2.1 time: 0.180231 Jan 10 11:41:53.265890 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 355/702] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:53 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:41:54.053346 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-34af8cdd-cf88-4dea-919a-1d39967a86f0 req-e65a050e-ba0c-4367-8b46-dfd25da8505c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064", "name": "network-vif-plugged", "status": "completed", "tag": "8ab8d3f6-83e5-470a-8aeb-12a8eb8223cd"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:41:54.055022 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:41:54.055022 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:41:54.062995 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-34af8cdd-cf88-4dea-919a-1d39967a86f0 req-e65a050e-ba0c-4367-8b46-dfd25da8505c service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:54.063446 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-34af8cdd-cf88-4dea-919a-1d39967a86f0 req-e65a050e-ba0c-4367-8b46-dfd25da8505c service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:54.075367 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-34af8cdd-cf88-4dea-919a-1d39967a86f0 req-e65a050e-ba0c-4367-8b46-dfd25da8505c service nova] Creating event network-vif-plugged:8ab8d3f6-83e5-470a-8aeb-12a8eb8223cd for instance 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 on hv-cinder-maste Jan 10 11:41:54.080398 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-34af8cdd-cf88-4dea-919a-1d39967a86f0 req-e65a050e-ba0c-4367-8b46-dfd25da8505c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030694 Jan 10 11:41:54.081006 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 348/703] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:41:54.216302 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b07f7102-f46f-41be-ad90-1c66f427d1aa tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:54.217078 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b07f7102-f46f-41be-ad90-1c66f427d1aa tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:54.225301 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b07f7102-f46f-41be-ad90-1c66f427d1aa tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:54.226095 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b07f7102-f46f-41be-ad90-1c66f427d1aa tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:54.227218 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b07f7102-f46f-41be-ad90-1c66f427d1aa tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:54.227873 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b07f7102-f46f-41be-ad90-1c66f427d1aa tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:54.282986 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-26b31ea9-06a2-4cab-b753-3eaca812bb8b tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:54.284283 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-26b31ea9-06a2-4cab-b753-3eaca812bb8b tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:54.292379 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-26b31ea9-06a2-4cab-b753-3eaca812bb8b tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:54.292379 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-26b31ea9-06a2-4cab-b753-3eaca812bb8b tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:54.292379 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-26b31ea9-06a2-4cab-b753-3eaca812bb8b tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:54.292379 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-26b31ea9-06a2-4cab-b753-3eaca812bb8b tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:54.418222 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b07f7102-f46f-41be-ad90-1c66f427d1aa tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:54.427580 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b07f7102-f46f-41be-ad90-1c66f427d1aa tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:54.430359 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b07f7102-f46f-41be-ad90-1c66f427d1aa tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:54.433072 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b07f7102-f46f-41be-ad90-1c66f427d1aa tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1407 microversion: 2.20 time: 0.220548 Jan 10 11:41:54.446694 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 356/704] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:54 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:41:54.508621 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-26b31ea9-06a2-4cab-b753-3eaca812bb8b tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:54.517816 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-26b31ea9-06a2-4cab-b753-3eaca812bb8b tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1313 microversion: 2.1 time: 0.239177 Jan 10 11:41:54.518526 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 349/705] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:54 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:41:55.451480 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2618794b-d9eb-4a02-a74e-bac2be1495c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:55.452156 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2618794b-d9eb-4a02-a74e-bac2be1495c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:55.458461 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2618794b-d9eb-4a02-a74e-bac2be1495c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:55.458917 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2618794b-d9eb-4a02-a74e-bac2be1495c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:55.459703 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2618794b-d9eb-4a02-a74e-bac2be1495c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:55.460144 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2618794b-d9eb-4a02-a74e-bac2be1495c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:55.536143 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-37789a78-0334-4d3f-b158-ea38d75e00e7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:55.537498 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-37789a78-0334-4d3f-b158-ea38d75e00e7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:55.544536 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-37789a78-0334-4d3f-b158-ea38d75e00e7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:55.544986 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-37789a78-0334-4d3f-b158-ea38d75e00e7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:55.546378 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-37789a78-0334-4d3f-b158-ea38d75e00e7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:55.546378 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-37789a78-0334-4d3f-b158-ea38d75e00e7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:55.626632 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2618794b-d9eb-4a02-a74e-bac2be1495c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:55.636353 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2618794b-d9eb-4a02-a74e-bac2be1495c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:55.637945 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2618794b-d9eb-4a02-a74e-bac2be1495c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:55.639090 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2618794b-d9eb-4a02-a74e-bac2be1495c8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1407 microversion: 2.20 time: 0.191359 Jan 10 11:41:55.639653 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 357/706] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:55 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:41:55.695701 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-37789a78-0334-4d3f-b158-ea38d75e00e7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:55.703873 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-37789a78-0334-4d3f-b158-ea38d75e00e7 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1313 microversion: 2.1 time: 0.172758 Jan 10 11:41:55.704458 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 350/707] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:55 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:41:56.657819 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0e70cbc7-03e5-4b16-b8d1-f5dc0106875f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:56.658676 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0e70cbc7-03e5-4b16-b8d1-f5dc0106875f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:56.665290 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e70cbc7-03e5-4b16-b8d1-f5dc0106875f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:56.665739 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e70cbc7-03e5-4b16-b8d1-f5dc0106875f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:56.666775 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e70cbc7-03e5-4b16-b8d1-f5dc0106875f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:56.667216 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e70cbc7-03e5-4b16-b8d1-f5dc0106875f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:56.720487 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ce8459b3-18ee-431c-91e2-bfb1a01c483d tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:56.721272 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ce8459b3-18ee-431c-91e2-bfb1a01c483d tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:56.727714 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ce8459b3-18ee-431c-91e2-bfb1a01c483d tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:56.728199 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ce8459b3-18ee-431c-91e2-bfb1a01c483d tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:56.729014 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ce8459b3-18ee-431c-91e2-bfb1a01c483d tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:56.729448 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ce8459b3-18ee-431c-91e2-bfb1a01c483d tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:56.861388 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0e70cbc7-03e5-4b16-b8d1-f5dc0106875f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:56.874498 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0e70cbc7-03e5-4b16-b8d1-f5dc0106875f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:56.876969 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0e70cbc7-03e5-4b16-b8d1-f5dc0106875f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:56.878798 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0e70cbc7-03e5-4b16-b8d1-f5dc0106875f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1407 microversion: 2.20 time: 0.225228 Jan 10 11:41:56.880051 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 358/708] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:56 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:41:56.903637 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ce8459b3-18ee-431c-91e2-bfb1a01c483d tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:56.911034 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ce8459b3-18ee-431c-91e2-bfb1a01c483d tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1497 microversion: 2.1 time: 0.194343 Jan 10 11:41:56.918967 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 351/709] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:56 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:41:57.902203 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f8e75ded-3e88-4c2b-b287-c53829632b4e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:57.907585 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f8e75ded-3e88-4c2b-b287-c53829632b4e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:57.916935 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f8e75ded-3e88-4c2b-b287-c53829632b4e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:57.927297 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f8e75ded-3e88-4c2b-b287-c53829632b4e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:57.927297 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f8e75ded-3e88-4c2b-b287-c53829632b4e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:57.927297 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f8e75ded-3e88-4c2b-b287-c53829632b4e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:57.934700 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-09c71a13-a62a-4561-9684-703573b72f35 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:57.935261 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-09c71a13-a62a-4561-9684-703573b72f35 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:57.942243 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-09c71a13-a62a-4561-9684-703573b72f35 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:57.942809 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-09c71a13-a62a-4561-9684-703573b72f35 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:57.943517 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-09c71a13-a62a-4561-9684-703573b72f35 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:57.943954 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-09c71a13-a62a-4561-9684-703573b72f35 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:57.970904 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-09c71a13-a62a-4561-9684-703573b72f35 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Going to try to terminate instance {{(pid=128719) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:41:58.331590 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f8e75ded-3e88-4c2b-b287-c53829632b4e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:58.333580 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-09c71a13-a62a-4561-9684-703573b72f35 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 204 len: 0 microversion: 2.1 time: 0.403316 Jan 10 11:41:58.337896 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 352/710] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:41:57 2022] DELETE /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 10 11:41:58.343593 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f8e75ded-3e88-4c2b-b287-c53829632b4e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:58.345215 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-da686940-6431-4c04-ba05-ba3eb68764c6 req-4125f09d-2bec-41ac-982e-3657f318faa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70029374-0ab3-49b9-880e-6a102761c463", "name": "network-vif-plugged", "status": "completed", "tag": "5d53e751-c135-4aa3-b56f-602088936cc0"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:41:58.345685 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f8e75ded-3e88-4c2b-b287-c53829632b4e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:58.347020 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f8e75ded-3e88-4c2b-b287-c53829632b4e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1407 microversion: 2.20 time: 0.449986 Jan 10 11:41:58.348099 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 359/711] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:57 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:41:58.352565 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-792273d1-f06f-445c-a1f9-75a84e4fc561 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:58.353240 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-792273d1-f06f-445c-a1f9-75a84e4fc561 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:58.355542 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:41:58.355542 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:41:58.359792 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-792273d1-f06f-445c-a1f9-75a84e4fc561 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:58.360432 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-792273d1-f06f-445c-a1f9-75a84e4fc561 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:58.361407 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-792273d1-f06f-445c-a1f9-75a84e4fc561 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:58.362003 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-792273d1-f06f-445c-a1f9-75a84e4fc561 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:58.371110 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-da686940-6431-4c04-ba05-ba3eb68764c6 req-4125f09d-2bec-41ac-982e-3657f318faa5 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:58.372040 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-da686940-6431-4c04-ba05-ba3eb68764c6 req-4125f09d-2bec-41ac-982e-3657f318faa5 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:58.393936 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-da686940-6431-4c04-ba05-ba3eb68764c6 req-4125f09d-2bec-41ac-982e-3657f318faa5 service nova] Creating event network-vif-plugged:5d53e751-c135-4aa3-b56f-602088936cc0 for instance 70029374-0ab3-49b9-880e-6a102761c463 on hv-cinder-maste Jan 10 11:41:58.402308 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-da686940-6431-4c04-ba05-ba3eb68764c6 req-4125f09d-2bec-41ac-982e-3657f318faa5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061907 Jan 10 11:41:58.403356 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 353/712] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:41:58.519156 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-792273d1-f06f-445c-a1f9-75a84e4fc561 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:58.527144 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-792273d1-f06f-445c-a1f9-75a84e4fc561 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1503 microversion: 2.1 time: 0.177891 Jan 10 11:41:58.527729 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 360/713] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:58 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:41:59.366569 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-6cab0a2e-22c2-492a-b5d0-df5957aa453a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:59.367182 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-6cab0a2e-22c2-492a-b5d0-df5957aa453a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:59.373604 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6cab0a2e-22c2-492a-b5d0-df5957aa453a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:59.374061 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6cab0a2e-22c2-492a-b5d0-df5957aa453a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:59.374893 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6cab0a2e-22c2-492a-b5d0-df5957aa453a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:59.375326 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6cab0a2e-22c2-492a-b5d0-df5957aa453a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:59.511128 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-6cab0a2e-22c2-492a-b5d0-df5957aa453a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:59.519121 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-6cab0a2e-22c2-492a-b5d0-df5957aa453a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:59.520620 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-6cab0a2e-22c2-492a-b5d0-df5957aa453a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:59.521712 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-6cab0a2e-22c2-492a-b5d0-df5957aa453a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1407 microversion: 2.20 time: 0.160070 Jan 10 11:41:59.522296 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 354/714] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:41:59 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:41:59.543742 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c5779ebb-85ca-4257-bfe6-f57045e9a8fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:41:59.544410 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c5779ebb-85ca-4257-bfe6-f57045e9a8fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:41:59.550670 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c5779ebb-85ca-4257-bfe6-f57045e9a8fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:59.551122 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c5779ebb-85ca-4257-bfe6-f57045e9a8fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:59.551895 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c5779ebb-85ca-4257-bfe6-f57045e9a8fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:41:59.552328 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c5779ebb-85ca-4257-bfe6-f57045e9a8fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:41:59.691794 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c5779ebb-85ca-4257-bfe6-f57045e9a8fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:41:59.702074 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c5779ebb-85ca-4257-bfe6-f57045e9a8fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1503 microversion: 2.1 time: 0.162000 Jan 10 11:41:59.702687 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 361/715] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:41:59 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:00.539558 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a74e9e78-b397-4f4f-8108-97e8945bf972 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:00.540290 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a74e9e78-b397-4f4f-8108-97e8945bf972 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:00.547841 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a74e9e78-b397-4f4f-8108-97e8945bf972 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:00.548383 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a74e9e78-b397-4f4f-8108-97e8945bf972 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:00.549298 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a74e9e78-b397-4f4f-8108-97e8945bf972 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:00.549813 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a74e9e78-b397-4f4f-8108-97e8945bf972 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:00.691066 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a74e9e78-b397-4f4f-8108-97e8945bf972 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:00.702101 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a74e9e78-b397-4f4f-8108-97e8945bf972 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:00.703827 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a74e9e78-b397-4f4f-8108-97e8945bf972 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:00.705383 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a74e9e78-b397-4f4f-8108-97e8945bf972 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1599 microversion: 2.20 time: 0.169558 Jan 10 11:42:00.709127 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 355/716] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:42:00 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:42:00.709438 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-78a380a0-4075-4e7a-92aa-715b61772429 req-454c7b75-dc0d-45e8-b7e1-13b6aa86aed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064", "name": "network-vif-deleted", "tag": "8ab8d3f6-83e5-470a-8aeb-12a8eb8223cd"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:00.711001 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:42:00.711001 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:42:00.719029 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-78a380a0-4075-4e7a-92aa-715b61772429 req-454c7b75-dc0d-45e8-b7e1-13b6aa86aed3 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:00.722037 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-78a380a0-4075-4e7a-92aa-715b61772429 req-454c7b75-dc0d-45e8-b7e1-13b6aa86aed3 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:00.722172 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-757f7b46-fe45-476d-b393-e537dbca4a28 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:00.722172 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-757f7b46-fe45-476d-b393-e537dbca4a28 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:00.727793 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-757f7b46-fe45-476d-b393-e537dbca4a28 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:00.728431 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-757f7b46-fe45-476d-b393-e537dbca4a28 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:00.729990 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-757f7b46-fe45-476d-b393-e537dbca4a28 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:00.730467 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-757f7b46-fe45-476d-b393-e537dbca4a28 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:00.732592 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-78a380a0-4075-4e7a-92aa-715b61772429 req-454c7b75-dc0d-45e8-b7e1-13b6aa86aed3 service nova] Creating event network-vif-deleted:8ab8d3f6-83e5-470a-8aeb-12a8eb8223cd for instance 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 on hv-cinder-maste Jan 10 11:42:00.737915 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-78a380a0-4075-4e7a-92aa-715b61772429 req-454c7b75-dc0d-45e8-b7e1-13b6aa86aed3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032020 Jan 10 11:42:00.739083 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 362/717] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:42:00.743932 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2ac8442c-2401-4d29-8a76-3e93fd007b67 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:00.744516 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2ac8442c-2401-4d29-8a76-3e93fd007b67 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:00.751835 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2ac8442c-2401-4d29-8a76-3e93fd007b67 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:00.752296 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2ac8442c-2401-4d29-8a76-3e93fd007b67 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:00.753157 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2ac8442c-2401-4d29-8a76-3e93fd007b67 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:00.753801 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2ac8442c-2401-4d29-8a76-3e93fd007b67 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:00.817045 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-757f7b46-fe45-476d-b393-e537dbca4a28 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:00.826019 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-757f7b46-fe45-476d-b393-e537dbca4a28 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 200 len: 1461 microversion: 2.1 time: 0.109228 Jan 10 11:42:00.826742 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 356/718] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:00 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 1461 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:42:00.875940 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2ac8442c-2401-4d29-8a76-3e93fd007b67 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.135890 Jan 10 11:42:00.876725 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 363/719] 10.222.0.20 () {60 vars in 1315 bytes} [Mon Jan 10 11:42:00 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:42:01.848764 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-74fa6771-9164-44a8-aa1a-123b162deb32 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:01.849372 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-74fa6771-9164-44a8-aa1a-123b162deb32 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:01.856572 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-74fa6771-9164-44a8-aa1a-123b162deb32 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:01.857022 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-74fa6771-9164-44a8-aa1a-123b162deb32 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:01.857811 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-74fa6771-9164-44a8-aa1a-123b162deb32 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:01.858271 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-74fa6771-9164-44a8-aa1a-123b162deb32 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:01.872883 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-74fa6771-9164-44a8-aa1a-123b162deb32 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] HTTP exception thrown: Instance 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 could not be found. Jan 10 11:42:01.873396 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-74fa6771-9164-44a8-aa1a-123b162deb32 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Returning 404 to user: Instance 42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:42:01.874422 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-74fa6771-9164-44a8-aa1a-123b162deb32 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064" status: 404 len: 111 microversion: 2.1 time: 0.029263 Jan 10 11:42:01.874788 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 357/720] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:01 2022] GET /compute/v2.1/servers/42bf5058-6c1c-4ed8-a3d6-bf9f28ceb064 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:42:01.972071 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-9f17df25-6471-4e13-9925-8bdcd561927e tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-619618420", "imageRef": "b6e63192-9c33-4d80-9555-6de2bb10fd32", "flavorRef": "452", "networks": [{"uuid": "ef46ac2a-9aa5-4568-beae-a9f54e14c6d0"}]}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:02.034450 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.network.neutron [None req-9f17df25-6471-4e13-9925-8bdcd561927e tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] validate_networks() for [('ef46ac2a-9aa5-4568-beae-a9f54e14c6d0', None, None, None, None, None)] {{(pid=128718) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:42:02.103184 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5581d76e-75b7-49ff-b10b-ff766184565e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:02.104206 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5581d76e-75b7-49ff-b10b-ff766184565e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:02.110725 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5581d76e-75b7-49ff-b10b-ff766184565e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:02.113469 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5581d76e-75b7-49ff-b10b-ff766184565e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:02.113469 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5581d76e-75b7-49ff-b10b-ff766184565e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:02.113469 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5581d76e-75b7-49ff-b10b-ff766184565e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:02.182331 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5581d76e-75b7-49ff-b10b-ff766184565e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 14 microversion: 2.20 time: 0.082887 Jan 10 11:42:02.185075 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 358/721] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:02 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:42:02.189884 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-5dc62827-5f50-4b79-ba9e-31646cf5237e req-96c15996-8719-4172-a275-33d453c73ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70029374-0ab3-49b9-880e-6a102761c463", "tag": "5d53e751-c135-4aa3-b56f-602088936cc0"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:02.191844 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:42:02.191844 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:42:02.204704 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-5dc62827-5f50-4b79-ba9e-31646cf5237e req-96c15996-8719-4172-a275-33d453c73ad8 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:02.205222 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-5dc62827-5f50-4b79-ba9e-31646cf5237e req-96c15996-8719-4172-a275-33d453c73ad8 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:02.217275 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-5dc62827-5f50-4b79-ba9e-31646cf5237e req-96c15996-8719-4172-a275-33d453c73ad8 service nova] Creating event network-changed:5d53e751-c135-4aa3-b56f-602088936cc0 for instance 70029374-0ab3-49b9-880e-6a102761c463 on hv-cinder-maste Jan 10 11:42:02.222346 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-5dc62827-5f50-4b79-ba9e-31646cf5237e req-96c15996-8719-4172-a275-33d453c73ad8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037036 Jan 10 11:42:02.223137 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 359/722] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:42:02.439919 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-9f17df25-6471-4e13-9925-8bdcd561927e tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Flavor limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:42:02.440345 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-9f17df25-6471-4e13-9925-8bdcd561927e tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Image limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:42:02.440912 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-9f17df25-6471-4e13-9925-8bdcd561927e tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Flavor pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:42:02.441316 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-9f17df25-6471-4e13-9925-8bdcd561927e tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Image pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:42:02.441723 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-9f17df25-6471-4e13-9925-8bdcd561927e tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:42:02.451406 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9f17df25-6471-4e13-9925-8bdcd561927e tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:02.451860 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9f17df25-6471-4e13-9925-8bdcd561927e tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:02.452690 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9f17df25-6471-4e13-9925-8bdcd561927e tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:02.453117 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9f17df25-6471-4e13-9925-8bdcd561927e tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:02.470799 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-9f17df25-6471-4e13-9925-8bdcd561927e tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Getting quotas for project 0f63270caad74d2ab5a02aa80ad08ea1. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:42:02.474955 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-9f17df25-6471-4e13-9925-8bdcd561927e tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Getting quotas for user 28cce52a599447de8e898b1d42801c7e and project 0f63270caad74d2ab5a02aa80ad08ea1. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:42:02.489499 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-9f17df25-6471-4e13-9925-8bdcd561927e tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Going to run 1 instances... {{(pid=128718) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:42:02.491875 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-9f17df25-6471-4e13-9925-8bdcd561927e tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e63192-9c33-4d80-9555-6de2bb10fd32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:42:02.800577 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-9f17df25-6471-4e13-9925-8bdcd561927e tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.832549 Jan 10 11:42:02.803647 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 364/723] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:42:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 11:42:02.812802 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-8e0d127b-331f-49da-a61d-f29350e0d2ea tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:02.813509 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-8e0d127b-331f-49da-a61d-f29350e0d2ea tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:02.874180 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-8e0d127b-331f-49da-a61d-f29350e0d2ea tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:02.883277 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-8e0d127b-331f-49da-a61d-f29350e0d2ea tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6" status: 200 len: 1213 microversion: 2.1 time: 0.074863 Jan 10 11:42:02.883855 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 360/724] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:02 2022] GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:03.194010 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3c1d53ab-9a00-4030-8d28-ed2751aafaa1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:03.195121 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3c1d53ab-9a00-4030-8d28-ed2751aafaa1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:03.202870 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3c1d53ab-9a00-4030-8d28-ed2751aafaa1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:03.203329 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3c1d53ab-9a00-4030-8d28-ed2751aafaa1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:03.204123 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3c1d53ab-9a00-4030-8d28-ed2751aafaa1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:03.204630 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3c1d53ab-9a00-4030-8d28-ed2751aafaa1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:03.267325 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3c1d53ab-9a00-4030-8d28-ed2751aafaa1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 14 microversion: 2.20 time: 0.076934 Jan 10 11:42:03.267972 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 365/725] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:03 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:42:03.900589 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b53b7783-15a6-4387-aa09-fa9efd293121 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:03.906905 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b53b7783-15a6-4387-aa09-fa9efd293121 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:03.909327 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b53b7783-15a6-4387-aa09-fa9efd293121 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:03.909826 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b53b7783-15a6-4387-aa09-fa9efd293121 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:03.911022 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b53b7783-15a6-4387-aa09-fa9efd293121 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:03.911471 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b53b7783-15a6-4387-aa09-fa9efd293121 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:03.973004 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-b53b7783-15a6-4387-aa09-fa9efd293121 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:03.981397 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b53b7783-15a6-4387-aa09-fa9efd293121 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6" status: 200 len: 1217 microversion: 2.1 time: 0.084660 Jan 10 11:42:03.981962 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 361/726] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:03 2022] GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:04.279519 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-15494381-40e9-4ba7-8843-a80a43e13212 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:04.280564 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-15494381-40e9-4ba7-8843-a80a43e13212 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:04.287588 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-15494381-40e9-4ba7-8843-a80a43e13212 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:04.288029 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-15494381-40e9-4ba7-8843-a80a43e13212 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:04.288845 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-15494381-40e9-4ba7-8843-a80a43e13212 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:04.289258 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-15494381-40e9-4ba7-8843-a80a43e13212 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:04.349067 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-15494381-40e9-4ba7-8843-a80a43e13212 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 14 microversion: 2.20 time: 0.074192 Jan 10 11:42:04.350340 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 366/727] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:04 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:42:05.001108 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5f52cf75-4e01-4a2e-b60d-37a880ad993b tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:05.001734 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5f52cf75-4e01-4a2e-b60d-37a880ad993b tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:05.008772 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5f52cf75-4e01-4a2e-b60d-37a880ad993b tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:05.009254 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5f52cf75-4e01-4a2e-b60d-37a880ad993b tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:05.010095 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5f52cf75-4e01-4a2e-b60d-37a880ad993b tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:05.011258 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5f52cf75-4e01-4a2e-b60d-37a880ad993b tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:05.077953 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5f52cf75-4e01-4a2e-b60d-37a880ad993b tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:05.090259 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5f52cf75-4e01-4a2e-b60d-37a880ad993b tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6" status: 200 len: 1273 microversion: 2.1 time: 0.092781 Jan 10 11:42:05.091216 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 362/728] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:04 2022] GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6 => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:05.361673 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-bb02c835-3714-41ea-b9cd-c0e1893b6816 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:05.362830 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-bb02c835-3714-41ea-b9cd-c0e1893b6816 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:05.370346 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bb02c835-3714-41ea-b9cd-c0e1893b6816 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:05.371043 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bb02c835-3714-41ea-b9cd-c0e1893b6816 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:05.371834 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bb02c835-3714-41ea-b9cd-c0e1893b6816 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:05.372275 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bb02c835-3714-41ea-b9cd-c0e1893b6816 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:05.445733 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-bb02c835-3714-41ea-b9cd-c0e1893b6816 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 14 microversion: 2.20 time: 0.088352 Jan 10 11:42:05.446969 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 367/729] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:05 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:06.108346 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-823fa4aa-1c5a-43b9-9ae6-0590ef5284c4 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:06.109001 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-823fa4aa-1c5a-43b9-9ae6-0590ef5284c4 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:06.115770 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-823fa4aa-1c5a-43b9-9ae6-0590ef5284c4 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:06.116222 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-823fa4aa-1c5a-43b9-9ae6-0590ef5284c4 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:06.117023 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-823fa4aa-1c5a-43b9-9ae6-0590ef5284c4 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:06.117464 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-823fa4aa-1c5a-43b9-9ae6-0590ef5284c4 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:06.260368 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-823fa4aa-1c5a-43b9-9ae6-0590ef5284c4 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:06.269314 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-823fa4aa-1c5a-43b9-9ae6-0590ef5284c4 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6" status: 200 len: 1313 microversion: 2.1 time: 0.164856 Jan 10 11:42:06.269889 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 363/730] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:06 2022] GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:06.457273 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0a8abff0-26a8-451f-bf20-cdf45f5abcbe tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:06.458295 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0a8abff0-26a8-451f-bf20-cdf45f5abcbe tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:06.465744 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0a8abff0-26a8-451f-bf20-cdf45f5abcbe tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:06.466194 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0a8abff0-26a8-451f-bf20-cdf45f5abcbe tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:06.467009 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0a8abff0-26a8-451f-bf20-cdf45f5abcbe tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:06.467446 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0a8abff0-26a8-451f-bf20-cdf45f5abcbe tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:06.531736 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0a8abff0-26a8-451f-bf20-cdf45f5abcbe tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 14 microversion: 2.20 time: 0.078392 Jan 10 11:42:06.532392 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 368/731] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:06 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:06.847507 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-ec5807ca-1284-45b1-adcd-a530f0d62186 req-a71632f4-2fe0-4e22-b6d7-894561920aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ae8880-2bd5-43b1-8285-1da9219dc7f6", "tag": "98e6a17f-ccfd-4771-87a1-c5dfa964759d"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:06.849060 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:42:06.849060 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:42:06.857027 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-ec5807ca-1284-45b1-adcd-a530f0d62186 req-a71632f4-2fe0-4e22-b6d7-894561920aa6 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:06.857476 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-ec5807ca-1284-45b1-adcd-a530f0d62186 req-a71632f4-2fe0-4e22-b6d7-894561920aa6 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:06.875774 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-ec5807ca-1284-45b1-adcd-a530f0d62186 req-a71632f4-2fe0-4e22-b6d7-894561920aa6 service nova] Creating event network-changed:98e6a17f-ccfd-4771-87a1-c5dfa964759d for instance 61ae8880-2bd5-43b1-8285-1da9219dc7f6 on hv-cinder-maste Jan 10 11:42:06.876872 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-ec5807ca-1284-45b1-adcd-a530f0d62186 req-a71632f4-2fe0-4e22-b6d7-894561920aa6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032929 Jan 10 11:42:06.877493 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 364/732] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:42:07.286757 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-1f7c60e9-cb8d-46ca-8fc6-baa4aefc9435 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:07.287486 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-1f7c60e9-cb8d-46ca-8fc6-baa4aefc9435 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:07.295300 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1f7c60e9-cb8d-46ca-8fc6-baa4aefc9435 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:07.295755 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1f7c60e9-cb8d-46ca-8fc6-baa4aefc9435 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:07.296548 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1f7c60e9-cb8d-46ca-8fc6-baa4aefc9435 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:07.296984 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1f7c60e9-cb8d-46ca-8fc6-baa4aefc9435 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:07.431861 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-1f7c60e9-cb8d-46ca-8fc6-baa4aefc9435 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:07.439999 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-1f7c60e9-cb8d-46ca-8fc6-baa4aefc9435 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6" status: 200 len: 1313 microversion: 2.1 time: 0.157303 Jan 10 11:42:07.440581 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 369/733] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:07 2022] GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:07.543690 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d034d65a-1a26-418e-a753-0f0bf58e1000 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:07.544704 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d034d65a-1a26-418e-a753-0f0bf58e1000 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:07.551089 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d034d65a-1a26-418e-a753-0f0bf58e1000 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:07.556219 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d034d65a-1a26-418e-a753-0f0bf58e1000 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:07.556219 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d034d65a-1a26-418e-a753-0f0bf58e1000 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:07.556219 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d034d65a-1a26-418e-a753-0f0bf58e1000 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:07.609352 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d034d65a-1a26-418e-a753-0f0bf58e1000 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 14 microversion: 2.20 time: 0.069938 Jan 10 11:42:07.609952 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 365/734] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:07 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:42:08.456896 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a946a7c8-b3bd-4340-bd51-0c89677c4ebf tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:08.457458 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a946a7c8-b3bd-4340-bd51-0c89677c4ebf tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:08.464180 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a946a7c8-b3bd-4340-bd51-0c89677c4ebf tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:08.464709 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a946a7c8-b3bd-4340-bd51-0c89677c4ebf tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:08.465497 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a946a7c8-b3bd-4340-bd51-0c89677c4ebf tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:08.465934 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a946a7c8-b3bd-4340-bd51-0c89677c4ebf tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:08.600458 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-a946a7c8-b3bd-4340-bd51-0c89677c4ebf tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:08.608733 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a946a7c8-b3bd-4340-bd51-0c89677c4ebf tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6" status: 200 len: 1313 microversion: 2.1 time: 0.155638 Jan 10 11:42:08.609333 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 370/735] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:08 2022] GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:08.621207 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a6f0ac08-e54d-48bb-9d9e-48a4b0296744 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:08.622251 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a6f0ac08-e54d-48bb-9d9e-48a4b0296744 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:08.629054 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a6f0ac08-e54d-48bb-9d9e-48a4b0296744 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:08.629498 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a6f0ac08-e54d-48bb-9d9e-48a4b0296744 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:08.630297 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a6f0ac08-e54d-48bb-9d9e-48a4b0296744 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:08.630728 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a6f0ac08-e54d-48bb-9d9e-48a4b0296744 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:08.689842 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a6f0ac08-e54d-48bb-9d9e-48a4b0296744 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 14 microversion: 2.20 time: 0.073406 Jan 10 11:42:08.690719 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 366/736] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:08 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:09.625248 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-80f59bb1-5d52-4cdc-b506-3bd4b2a80388 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:09.625841 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-80f59bb1-5d52-4cdc-b506-3bd4b2a80388 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:09.633664 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-80f59bb1-5d52-4cdc-b506-3bd4b2a80388 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:09.634112 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-80f59bb1-5d52-4cdc-b506-3bd4b2a80388 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:09.638285 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-80f59bb1-5d52-4cdc-b506-3bd4b2a80388 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:09.638738 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-80f59bb1-5d52-4cdc-b506-3bd4b2a80388 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:09.701460 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-27728170-a40d-4488-83a7-0da84a64108b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:09.702528 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-27728170-a40d-4488-83a7-0da84a64108b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:09.709754 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-27728170-a40d-4488-83a7-0da84a64108b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:09.710240 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-27728170-a40d-4488-83a7-0da84a64108b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:09.711037 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-27728170-a40d-4488-83a7-0da84a64108b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:09.711463 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-27728170-a40d-4488-83a7-0da84a64108b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:09.785430 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-27728170-a40d-4488-83a7-0da84a64108b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 14 microversion: 2.20 time: 0.087906 Jan 10 11:42:09.788413 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 367/737] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:09 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:42:09.797944 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-80f59bb1-5d52-4cdc-b506-3bd4b2a80388 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:09.806155 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-80f59bb1-5d52-4cdc-b506-3bd4b2a80388 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6" status: 200 len: 1313 microversion: 2.1 time: 0.184509 Jan 10 11:42:09.806787 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 371/738] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:09 2022] GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:10.796761 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-0f397f0d-4e24-4c3e-b6f3-2996501a5497 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:10.797768 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-0f397f0d-4e24-4c3e-b6f3-2996501a5497 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:10.804668 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0f397f0d-4e24-4c3e-b6f3-2996501a5497 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:10.805119 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0f397f0d-4e24-4c3e-b6f3-2996501a5497 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:10.805903 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0f397f0d-4e24-4c3e-b6f3-2996501a5497 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:10.806379 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0f397f0d-4e24-4c3e-b6f3-2996501a5497 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:10.824633 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-47166ff6-90a6-46c4-945a-8cd74c1bbb66 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:10.825257 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-47166ff6-90a6-46c4-945a-8cd74c1bbb66 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:10.831972 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-47166ff6-90a6-46c4-945a-8cd74c1bbb66 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:10.832426 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-47166ff6-90a6-46c4-945a-8cd74c1bbb66 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:10.834166 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-47166ff6-90a6-46c4-945a-8cd74c1bbb66 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:10.834664 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-47166ff6-90a6-46c4-945a-8cd74c1bbb66 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:10.868324 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-0f397f0d-4e24-4c3e-b6f3-2996501a5497 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 14 microversion: 2.20 time: 0.075465 Jan 10 11:42:10.868993 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 368/739] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:10 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:10.965419 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-47166ff6-90a6-46c4-945a-8cd74c1bbb66 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:10.972844 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-47166ff6-90a6-46c4-945a-8cd74c1bbb66 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6" status: 200 len: 1313 microversion: 2.1 time: 0.153085 Jan 10 11:42:10.973416 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 372/740] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:10 2022] GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:11.880818 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ab464299-561a-4f5f-8aca-2e2e6cde7587 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:11.881819 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ab464299-561a-4f5f-8aca-2e2e6cde7587 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:11.889848 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ab464299-561a-4f5f-8aca-2e2e6cde7587 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:11.890341 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ab464299-561a-4f5f-8aca-2e2e6cde7587 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:11.891154 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ab464299-561a-4f5f-8aca-2e2e6cde7587 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:11.891939 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ab464299-561a-4f5f-8aca-2e2e6cde7587 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:11.953386 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ab464299-561a-4f5f-8aca-2e2e6cde7587 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 14 microversion: 2.20 time: 0.076560 Jan 10 11:42:11.954462 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 369/741] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:11 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:11.988871 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-12220816-11d3-4580-9b8c-b49e9fc110d8 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:11.989775 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-12220816-11d3-4580-9b8c-b49e9fc110d8 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:11.996765 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-12220816-11d3-4580-9b8c-b49e9fc110d8 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:11.997225 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-12220816-11d3-4580-9b8c-b49e9fc110d8 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:11.998034 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-12220816-11d3-4580-9b8c-b49e9fc110d8 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:11.998512 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-12220816-11d3-4580-9b8c-b49e9fc110d8 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:12.120664 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-6f2467d5-11dd-4bc1-89f1-56482ce006b2 req-d4355e29-f1ec-4158-8db5-9708a28fdb5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ae8880-2bd5-43b1-8285-1da9219dc7f6", "name": "network-vif-plugged", "status": "completed", "tag": "98e6a17f-ccfd-4771-87a1-c5dfa964759d"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:12.122835 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:42:12.122835 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:42:12.131331 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-6f2467d5-11dd-4bc1-89f1-56482ce006b2 req-d4355e29-f1ec-4158-8db5-9708a28fdb5b service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:12.131785 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-6f2467d5-11dd-4bc1-89f1-56482ce006b2 req-d4355e29-f1ec-4158-8db5-9708a28fdb5b service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:12.140822 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-12220816-11d3-4580-9b8c-b49e9fc110d8 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:12.148994 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-6f2467d5-11dd-4bc1-89f1-56482ce006b2 req-d4355e29-f1ec-4158-8db5-9708a28fdb5b service nova] Creating event network-vif-plugged:98e6a17f-ccfd-4771-87a1-c5dfa964759d for instance 61ae8880-2bd5-43b1-8285-1da9219dc7f6 on hv-cinder-maste Jan 10 11:42:12.148994 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-6f2467d5-11dd-4bc1-89f1-56482ce006b2 req-d4355e29-f1ec-4158-8db5-9708a28fdb5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032441 Jan 10 11:42:12.148994 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 370/742] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:42:12.150087 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-12220816-11d3-4580-9b8c-b49e9fc110d8 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6" status: 200 len: 1313 microversion: 2.1 time: 0.164696 Jan 10 11:42:12.154370 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 373/743] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:11 2022] GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:12.966150 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3fd79123-60c9-4234-9247-23911dab3938 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:12.967169 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-3fd79123-60c9-4234-9247-23911dab3938 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:12.973278 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3fd79123-60c9-4234-9247-23911dab3938 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:12.973733 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3fd79123-60c9-4234-9247-23911dab3938 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:12.974546 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3fd79123-60c9-4234-9247-23911dab3938 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:12.974982 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3fd79123-60c9-4234-9247-23911dab3938 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:13.109293 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3fd79123-60c9-4234-9247-23911dab3938 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 10414 microversion: 2.20 time: 0.147893 Jan 10 11:42:13.109854 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 371/744] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:12 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 10414 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:13.166816 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0d04b6cd-eeb6-49a8-ab4e-c903b8b147fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:13.168077 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0d04b6cd-eeb6-49a8-ab4e-c903b8b147fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:13.174482 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0d04b6cd-eeb6-49a8-ab4e-c903b8b147fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:13.174941 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0d04b6cd-eeb6-49a8-ab4e-c903b8b147fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:13.175722 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0d04b6cd-eeb6-49a8-ab4e-c903b8b147fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:13.176163 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0d04b6cd-eeb6-49a8-ab4e-c903b8b147fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:13.309361 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0d04b6cd-eeb6-49a8-ab4e-c903b8b147fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:13.316737 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0d04b6cd-eeb6-49a8-ab4e-c903b8b147fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6" status: 200 len: 1313 microversion: 2.1 time: 0.153626 Jan 10 11:42:13.317313 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 374/745] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:13 2022] GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:13.842565 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9150d9b0-e153-42d9-b523-8275d0b0fcd8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:13.843578 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9150d9b0-e153-42d9-b523-8275d0b0fcd8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:13.850551 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9150d9b0-e153-42d9-b523-8275d0b0fcd8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:13.851016 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9150d9b0-e153-42d9-b523-8275d0b0fcd8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:13.851791 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9150d9b0-e153-42d9-b523-8275d0b0fcd8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:13.852224 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9150d9b0-e153-42d9-b523-8275d0b0fcd8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:13.880918 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9150d9b0-e153-42d9-b523-8275d0b0fcd8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042603 Jan 10 11:42:13.881473 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 372/746] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:42:13 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:42:13.939838 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-498f059e-2c84-4b50-a866-a23edb268ac8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:13.940151 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-498f059e-2c84-4b50-a866-a23edb268ac8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:13.949850 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-498f059e-2c84-4b50-a866-a23edb268ac8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:13.950345 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-498f059e-2c84-4b50-a866-a23edb268ac8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:13.951152 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-498f059e-2c84-4b50-a866-a23edb268ac8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:13.951589 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-498f059e-2c84-4b50-a866-a23edb268ac8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:13.978388 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-498f059e-2c84-4b50-a866-a23edb268ac8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Going to try to terminate instance {{(pid=128718) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:42:14.120950 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-fe81d419-a385-41a3-b13f-9e700f5d3559 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:14.121777 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-fe81d419-a385-41a3-b13f-9e700f5d3559 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:14.128878 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fe81d419-a385-41a3-b13f-9e700f5d3559 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:14.129330 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fe81d419-a385-41a3-b13f-9e700f5d3559 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:14.130148 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fe81d419-a385-41a3-b13f-9e700f5d3559 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:14.130707 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fe81d419-a385-41a3-b13f-9e700f5d3559 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:14.200841 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-fe81d419-a385-41a3-b13f-9e700f5d3559 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 16280 microversion: 2.20 time: 0.083635 Jan 10 11:42:14.201491 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 373/747] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:14 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 16280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 11:42:14.335080 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3576ef33-75c3-42ae-b3ed-e577b68a05fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:14.335812 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-3576ef33-75c3-42ae-b3ed-e577b68a05fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:14.343185 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3576ef33-75c3-42ae-b3ed-e577b68a05fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:14.343646 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3576ef33-75c3-42ae-b3ed-e577b68a05fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:14.344946 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3576ef33-75c3-42ae-b3ed-e577b68a05fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:14.344946 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3576ef33-75c3-42ae-b3ed-e577b68a05fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:14.345344 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-498f059e-2c84-4b50-a866-a23edb268ac8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "DELETE /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 204 len: 0 microversion: 2.1 time: 0.409046 Jan 10 11:42:14.346533 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 375/748] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:42:13 2022] DELETE /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:42:14.355652 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a128f125-1e51-4006-b4e8-933f16ab6f18 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:14.356113 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a128f125-1e51-4006-b4e8-933f16ab6f18 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:14.362237 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a128f125-1e51-4006-b4e8-933f16ab6f18 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:14.362709 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a128f125-1e51-4006-b4e8-933f16ab6f18 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:14.363508 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a128f125-1e51-4006-b4e8-933f16ab6f18 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:14.363959 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a128f125-1e51-4006-b4e8-933f16ab6f18 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:14.785363 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-3576ef33-75c3-42ae-b3ed-e577b68a05fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:14.793785 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3576ef33-75c3-42ae-b3ed-e577b68a05fd tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6" status: 200 len: 1496 microversion: 2.1 time: 0.462910 Jan 10 11:42:14.793971 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-a128f125-1e51-4006-b4e8-933f16ab6f18 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:14.794758 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 374/749] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:14 2022] GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6 => generated 1496 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:42:14.801960 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a128f125-1e51-4006-b4e8-933f16ab6f18 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1672 microversion: 2.1 time: 0.450947 Jan 10 11:42:14.802599 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 376/750] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:14 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1672 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:42:15.212676 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-44346dd0-fd2f-44ae-91e9-2e4ae4f91023 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:15.213513 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-44346dd0-fd2f-44ae-91e9-2e4ae4f91023 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:15.221184 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-44346dd0-fd2f-44ae-91e9-2e4ae4f91023 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:15.221634 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-44346dd0-fd2f-44ae-91e9-2e4ae4f91023 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:15.222454 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-44346dd0-fd2f-44ae-91e9-2e4ae4f91023 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:15.222887 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-44346dd0-fd2f-44ae-91e9-2e4ae4f91023 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:15.302535 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-44346dd0-fd2f-44ae-91e9-2e4ae4f91023 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 18356 microversion: 2.20 time: 0.092531 Jan 10 11:42:15.302535 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 375/751] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:15 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 18356 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 11:42:15.804401 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-92614306-1b3c-4ea1-9631-6cd12ea45698 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:15.805119 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-92614306-1b3c-4ea1-9631-6cd12ea45698 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:15.812320 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-92614306-1b3c-4ea1-9631-6cd12ea45698 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:15.816671 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-92614306-1b3c-4ea1-9631-6cd12ea45698 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:15.816671 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-92614306-1b3c-4ea1-9631-6cd12ea45698 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:15.816671 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-92614306-1b3c-4ea1-9631-6cd12ea45698 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:15.820430 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ee8f434b-368c-4dca-bad6-42547c75c5b2 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:15.821138 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ee8f434b-368c-4dca-bad6-42547c75c5b2 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:15.829272 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ee8f434b-368c-4dca-bad6-42547c75c5b2 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:15.829758 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ee8f434b-368c-4dca-bad6-42547c75c5b2 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:15.830608 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ee8f434b-368c-4dca-bad6-42547c75c5b2 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:15.831053 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ee8f434b-368c-4dca-bad6-42547c75c5b2 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:15.840724 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-92614306-1b3c-4ea1-9631-6cd12ea45698 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] Going to try to terminate instance {{(pid=128718) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:42:15.965422 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ee8f434b-368c-4dca-bad6-42547c75c5b2 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:15.973384 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ee8f434b-368c-4dca-bad6-42547c75c5b2 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1672 microversion: 2.1 time: 0.157073 Jan 10 11:42:15.973944 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 376/752] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:15 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:42:16.209247 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-92614306-1b3c-4ea1-9631-6cd12ea45698 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "DELETE /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6" status: 204 len: 0 microversion: 2.1 time: 0.408181 Jan 10 11:42:16.209803 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 377/753] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:42:15 2022] DELETE /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:42:16.218715 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9fdcdbe6-2db1-40b3-bba9-2185c6d08909 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:16.219468 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9fdcdbe6-2db1-40b3-bba9-2185c6d08909 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:16.225986 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9fdcdbe6-2db1-40b3-bba9-2185c6d08909 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:16.226486 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9fdcdbe6-2db1-40b3-bba9-2185c6d08909 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:16.227280 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9fdcdbe6-2db1-40b3-bba9-2185c6d08909 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:16.227750 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9fdcdbe6-2db1-40b3-bba9-2185c6d08909 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:16.313950 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-eaa9a4cc-e9d8-439b-8777-f95e8a845445 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:16.314966 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-eaa9a4cc-e9d8-439b-8777-f95e8a845445 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:16.321421 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-eaa9a4cc-e9d8-439b-8777-f95e8a845445 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:16.321955 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-eaa9a4cc-e9d8-439b-8777-f95e8a845445 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:16.322871 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-eaa9a4cc-e9d8-439b-8777-f95e8a845445 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:16.323417 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-eaa9a4cc-e9d8-439b-8777-f95e8a845445 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:16.365969 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9fdcdbe6-2db1-40b3-bba9-2185c6d08909 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:16.374838 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9fdcdbe6-2db1-40b3-bba9-2185c6d08909 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6" status: 200 len: 1502 microversion: 2.1 time: 0.160521 Jan 10 11:42:16.375421 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 377/754] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:16 2022] GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:16.394070 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-eaa9a4cc-e9d8-439b-8777-f95e8a845445 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 19841 microversion: 2.20 time: 0.084111 Jan 10 11:42:16.394776 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 378/755] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:16 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 19841 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 11:42:16.991649 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f10878a6-19f1-454c-ada7-274433b457d8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:16.992279 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f10878a6-19f1-454c-ada7-274433b457d8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:16.998916 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f10878a6-19f1-454c-ada7-274433b457d8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:16.999371 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f10878a6-19f1-454c-ada7-274433b457d8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:17.000166 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f10878a6-19f1-454c-ada7-274433b457d8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:17.000607 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f10878a6-19f1-454c-ada7-274433b457d8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:17.140055 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-f10878a6-19f1-454c-ada7-274433b457d8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:17.148367 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f10878a6-19f1-454c-ada7-274433b457d8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1672 microversion: 2.1 time: 0.160628 Jan 10 11:42:17.149167 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 378/756] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:16 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:17.394979 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4b34aa5e-fe36-4380-973e-c0b7b6701948 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:17.397100 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4b34aa5e-fe36-4380-973e-c0b7b6701948 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:17.406605 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4b34aa5e-fe36-4380-973e-c0b7b6701948 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:17.406998 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4b34aa5e-fe36-4380-973e-c0b7b6701948 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:17.407956 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4b34aa5e-fe36-4380-973e-c0b7b6701948 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:17.408390 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4b34aa5e-fe36-4380-973e-c0b7b6701948 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:17.411098 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-bde18e32-3df4-4a64-bf73-ba2cff8fd2c7 req-f367e821-6736-4754-b784-d9c78110b0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de742531-93dd-4422-b11c-57c35a136f6e", "name": "network-vif-deleted", "tag": "1402bd72-ebce-40e3-b2fe-9132d0fbe846"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:17.415339 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:42:17.415339 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:42:17.420428 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-bde18e32-3df4-4a64-bf73-ba2cff8fd2c7 req-f367e821-6736-4754-b784-d9c78110b0aa service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:17.421446 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-bde18e32-3df4-4a64-bf73-ba2cff8fd2c7 req-f367e821-6736-4754-b784-d9c78110b0aa service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:17.434519 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-bde18e32-3df4-4a64-bf73-ba2cff8fd2c7 req-f367e821-6736-4754-b784-d9c78110b0aa service nova] Creating event network-vif-deleted:1402bd72-ebce-40e3-b2fe-9132d0fbe846 for instance de742531-93dd-4422-b11c-57c35a136f6e on hv-cinder-maste Jan 10 11:42:17.439881 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-bde18e32-3df4-4a64-bf73-ba2cff8fd2c7 req-f367e821-6736-4754-b784-d9c78110b0aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033447 Jan 10 11:42:17.440584 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 379/757] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:42:17.449119 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d6150dc0-377f-4087-b0de-857d34281acc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:17.449419 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d6150dc0-377f-4087-b0de-857d34281acc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:17.460469 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d6150dc0-377f-4087-b0de-857d34281acc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:17.461279 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d6150dc0-377f-4087-b0de-857d34281acc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:17.462445 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d6150dc0-377f-4087-b0de-857d34281acc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:17.463081 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d6150dc0-377f-4087-b0de-857d34281acc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:17.567800 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d6150dc0-377f-4087-b0de-857d34281acc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 22489 microversion: 2.20 time: 0.125404 Jan 10 11:42:17.568808 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 380/758] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:17 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 22489 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:17.597721 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4b34aa5e-fe36-4380-973e-c0b7b6701948 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:17.607989 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4b34aa5e-fe36-4380-973e-c0b7b6701948 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6" status: 200 len: 1502 microversion: 2.1 time: 0.217474 Jan 10 11:42:17.614259 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 379/759] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:17 2022] GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6 => generated 1502 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:18.166788 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e6bfb3c4-9b46-42bf-a003-20f5cad1504d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:18.168129 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-e6bfb3c4-9b46-42bf-a003-20f5cad1504d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:18.175125 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e6bfb3c4-9b46-42bf-a003-20f5cad1504d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:18.175580 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e6bfb3c4-9b46-42bf-a003-20f5cad1504d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:18.176372 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e6bfb3c4-9b46-42bf-a003-20f5cad1504d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:18.176926 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e6bfb3c4-9b46-42bf-a003-20f5cad1504d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:18.211321 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e6bfb3c4-9b46-42bf-a003-20f5cad1504d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:18.211780 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e6bfb3c4-9b46-42bf-a003-20f5cad1504d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:18.212227 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-e6bfb3c4-9b46-42bf-a003-20f5cad1504d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lazy-loading 'fault' on Instance uuid de742531-93dd-4422-b11c-57c35a136f6e {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:42:18.253616 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-e6bfb3c4-9b46-42bf-a003-20f5cad1504d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:18.262713 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-e6bfb3c4-9b46-42bf-a003-20f5cad1504d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 200 len: 1328 microversion: 2.1 time: 0.100101 Jan 10 11:42:18.268441 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 381/760] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:18 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:18.580880 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-9f3e0f98-13dd-4b98-a419-67ddd5a8c713 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:18.582087 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-9f3e0f98-13dd-4b98-a419-67ddd5a8c713 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:18.589920 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9f3e0f98-13dd-4b98-a419-67ddd5a8c713 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:18.590533 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9f3e0f98-13dd-4b98-a419-67ddd5a8c713 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:18.591395 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9f3e0f98-13dd-4b98-a419-67ddd5a8c713 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:18.591837 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9f3e0f98-13dd-4b98-a419-67ddd5a8c713 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:18.624812 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d76b37a1-1ccd-4422-8f6b-89ff4c17b101 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:18.625430 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d76b37a1-1ccd-4422-8f6b-89ff4c17b101 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:18.631899 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d76b37a1-1ccd-4422-8f6b-89ff4c17b101 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:18.632380 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d76b37a1-1ccd-4422-8f6b-89ff4c17b101 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:18.633156 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d76b37a1-1ccd-4422-8f6b-89ff4c17b101 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:18.633597 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d76b37a1-1ccd-4422-8f6b-89ff4c17b101 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:18.665667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-9f3e0f98-13dd-4b98-a419-67ddd5a8c713 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 23911 microversion: 2.20 time: 0.088820 Jan 10 11:42:18.666549 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 380/761] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:18 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 23911 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:18.721215 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-d76b37a1-1ccd-4422-8f6b-89ff4c17b101 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28cce52a599447de8e898b1d42801c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f63270caad74d2ab5a02aa80ad08ea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:18.721215 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d76b37a1-1ccd-4422-8f6b-89ff4c17b101 tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6" status: 200 len: 1460 microversion: 2.1 time: 0.082573 Jan 10 11:42:18.721215 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 382/762] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:18 2022] GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6 => generated 1460 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:42:19.280925 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ac399435-b2f2-4572-8750-e8321a63f986 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:19.281644 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ac399435-b2f2-4572-8750-e8321a63f986 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:19.288539 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ac399435-b2f2-4572-8750-e8321a63f986 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:19.288980 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ac399435-b2f2-4572-8750-e8321a63f986 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:19.289843 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ac399435-b2f2-4572-8750-e8321a63f986 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:19.290323 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ac399435-b2f2-4572-8750-e8321a63f986 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:19.305024 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-ac399435-b2f2-4572-8750-e8321a63f986 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] HTTP exception thrown: Instance de742531-93dd-4422-b11c-57c35a136f6e could not be found. Jan 10 11:42:19.305620 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ac399435-b2f2-4572-8750-e8321a63f986 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Returning 404 to user: Instance de742531-93dd-4422-b11c-57c35a136f6e could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:42:19.308466 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ac399435-b2f2-4572-8750-e8321a63f986 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 404 len: 111 microversion: 2.1 time: 0.029805 Jan 10 11:42:19.308466 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 381/763] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:19 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:42:19.316067 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-1d915daf-799a-4127-8dfd-cfe8bb1e17ba tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '.version_select at 0x7f47799500d0>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:19.397718 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-1d915daf-799a-4127-8dfd-cfe8bb1e17ba tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037529567" status: 202 len: 0 microversion: 2.1 time: 0.085158 Jan 10 11:42:19.401149 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 383/764] 10.222.0.20 () {58 vars in 1220 bytes} [Mon Jan 10 11:42:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037529567 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:19.457847 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-428e45ce-7f42-47bd-979b-541b9a0d853f req-ee615b1d-ccf3-4c9d-bbfa-d5825405593c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ae8880-2bd5-43b1-8285-1da9219dc7f6", "name": "network-vif-deleted", "tag": "98e6a17f-ccfd-4771-87a1-c5dfa964759d"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:19.459880 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:42:19.459880 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:42:19.467228 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-428e45ce-7f42-47bd-979b-541b9a0d853f req-ee615b1d-ccf3-4c9d-bbfa-d5825405593c service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:19.473448 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-428e45ce-7f42-47bd-979b-541b9a0d853f req-ee615b1d-ccf3-4c9d-bbfa-d5825405593c service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:19.478925 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-428e45ce-7f42-47bd-979b-541b9a0d853f req-ee615b1d-ccf3-4c9d-bbfa-d5825405593c service nova] Creating event network-vif-deleted:98e6a17f-ccfd-4771-87a1-c5dfa964759d for instance 61ae8880-2bd5-43b1-8285-1da9219dc7f6 on hv-cinder-maste Jan 10 11:42:19.487640 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-428e45ce-7f42-47bd-979b-541b9a0d853f req-ee615b1d-ccf3-4c9d-bbfa-d5825405593c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035053 Jan 10 11:42:19.488590 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 382/765] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:42:19.715219 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ba9d9779-121f-480d-be0a-0243db6adebc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:19.716637 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ba9d9779-121f-480d-be0a-0243db6adebc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:19.722640 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0136e1cb-fb90-4827-819a-1d7f7cb7297d tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:19.723599 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ba9d9779-121f-480d-be0a-0243db6adebc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:19.724053 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ba9d9779-121f-480d-be0a-0243db6adebc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:19.724172 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0136e1cb-fb90-4827-819a-1d7f7cb7297d tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] [instance: 61ae8880-2bd5-43b1-8285-1da9219dc7f6] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:19.724848 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ba9d9779-121f-480d-be0a-0243db6adebc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:19.725338 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ba9d9779-121f-480d-be0a-0243db6adebc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:19.731432 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0136e1cb-fb90-4827-819a-1d7f7cb7297d tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:19.732136 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0136e1cb-fb90-4827-819a-1d7f7cb7297d tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:19.732936 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0136e1cb-fb90-4827-819a-1d7f7cb7297d tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:19.733371 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0136e1cb-fb90-4827-819a-1d7f7cb7297d tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:19.747551 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-0136e1cb-fb90-4827-819a-1d7f7cb7297d tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] HTTP exception thrown: Instance 61ae8880-2bd5-43b1-8285-1da9219dc7f6 could not be found. Jan 10 11:42:19.748549 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0136e1cb-fb90-4827-819a-1d7f7cb7297d tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] Returning 404 to user: Instance 61ae8880-2bd5-43b1-8285-1da9219dc7f6 could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:42:19.749274 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0136e1cb-fb90-4827-819a-1d7f7cb7297d tempest-VolumesActionsTest-1974171497 tempest-VolumesActionsTest-1974171497-project] 10.222.0.20 "GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6" status: 404 len: 111 microversion: 2.1 time: 0.031541 Jan 10 11:42:19.749819 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 383/766] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:19 2022] GET /compute/v2.1/servers/61ae8880-2bd5-43b1-8285-1da9219dc7f6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 10 11:42:19.795580 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ba9d9779-121f-480d-be0a-0243db6adebc tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 25838 microversion: 2.20 time: 0.085239 Jan 10 11:42:19.800463 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 384/767] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:19 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 25838 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:20.258546 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-430c7b23-61bd-481e-b6a0-fbae49ee3aa5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'create', calling method: .version_select at 0x7f4779986b80>, body: {"keypair": {"name": "tempest-keypair-424959693"}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:20.273534 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-430c7b23-61bd-481e-b6a0-fbae49ee3aa5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Getting quotas for project f8635cce808f4b1c9e754fe407a2f60b. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:42:20.278466 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-430c7b23-61bd-481e-b6a0-fbae49ee3aa5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Getting quotas for user 0a3ea138daa84701bbf756e1ec43fb4c and project f8635cce808f4b1c9e754fe407a2f60b. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:42:20.613119 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-430c7b23-61bd-481e-b6a0-fbae49ee3aa5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Getting quotas for project f8635cce808f4b1c9e754fe407a2f60b. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:42:20.617220 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-430c7b23-61bd-481e-b6a0-fbae49ee3aa5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Getting quotas for user 0a3ea138daa84701bbf756e1ec43fb4c and project f8635cce808f4b1c9e754fe407a2f60b. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:42:20.631036 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-430c7b23-61bd-481e-b6a0-fbae49ee3aa5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.376374 Jan 10 11:42:20.631694 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 384/768] 10.222.0.20 () {60 vars in 1157 bytes} [Mon Jan 10 11:42:20 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:20.811970 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-bb976ac8-5351-458b-9ea8-4344859021d8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:20.813014 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-bb976ac8-5351-458b-9ea8-4344859021d8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:20.820475 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bb976ac8-5351-458b-9ea8-4344859021d8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:20.821012 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bb976ac8-5351-458b-9ea8-4344859021d8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:20.821810 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bb976ac8-5351-458b-9ea8-4344859021d8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:20.822467 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bb976ac8-5351-458b-9ea8-4344859021d8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:20.898912 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-bb976ac8-5351-458b-9ea8-4344859021d8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 27110 microversion: 2.20 time: 0.092062 Jan 10 11:42:20.903513 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 385/769] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:20 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 27110 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:21.911973 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-65f95275-91f3-4e70-abc5-0d71262c781f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:21.912911 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-65f95275-91f3-4e70-abc5-0d71262c781f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:21.920539 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-65f95275-91f3-4e70-abc5-0d71262c781f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:21.920992 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-65f95275-91f3-4e70-abc5-0d71262c781f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:21.921785 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-65f95275-91f3-4e70-abc5-0d71262c781f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:21.922249 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-65f95275-91f3-4e70-abc5-0d71262c781f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:23.083894 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-16ca79d6-c0c9-4e0a-8558-0e59116be413 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1318355574", "imageRef": "b6e63192-9c33-4d80-9555-6de2bb10fd32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "757f6b2b-0d86-4b1c-8fbb-5ee1a7cfe7ea"}], "security_groups": [{"name": "tempest-securitygroup--1719674622"}], "key_name": "tempest-keypair-424959693", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:23.194473 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.network.neutron [None req-16ca79d6-c0c9-4e0a-8558-0e59116be413 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] validate_networks() for [('757f6b2b-0d86-4b1c-8fbb-5ee1a7cfe7ea', None, None, None, None, None)] {{(pid=128719) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:42:23.559531 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-16ca79d6-c0c9-4e0a-8558-0e59116be413 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Flavor limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:42:23.559955 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-16ca79d6-c0c9-4e0a-8558-0e59116be413 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Image limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:42:23.560433 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-16ca79d6-c0c9-4e0a-8558-0e59116be413 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Flavor pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:42:23.560870 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-16ca79d6-c0c9-4e0a-8558-0e59116be413 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Image pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:42:23.561336 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-16ca79d6-c0c9-4e0a-8558-0e59116be413 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:42:23.570101 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-16ca79d6-c0c9-4e0a-8558-0e59116be413 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:23.570580 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-16ca79d6-c0c9-4e0a-8558-0e59116be413 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:23.571448 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-16ca79d6-c0c9-4e0a-8558-0e59116be413 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:23.571889 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-16ca79d6-c0c9-4e0a-8558-0e59116be413 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:23.588335 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-16ca79d6-c0c9-4e0a-8558-0e59116be413 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Getting quotas for project f8635cce808f4b1c9e754fe407a2f60b. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:42:23.592765 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-16ca79d6-c0c9-4e0a-8558-0e59116be413 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Getting quotas for user 0a3ea138daa84701bbf756e1ec43fb4c and project f8635cce808f4b1c9e754fe407a2f60b. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:42:23.603369 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-16ca79d6-c0c9-4e0a-8558-0e59116be413 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Going to run 1 instances... {{(pid=128719) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:42:23.606385 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-16ca79d6-c0c9-4e0a-8558-0e59116be413 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e63192-9c33-4d80-9555-6de2bb10fd32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:42:23.763748 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-16ca79d6-c0c9-4e0a-8558-0e59116be413 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.684326 Jan 10 11:42:23.764618 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 386/770] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:42:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 10 11:42:23.774476 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-244a5c8e-c8f6-4905-88c2-5068157842c3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:23.775103 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-244a5c8e-c8f6-4905-88c2-5068157842c3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:23.834231 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-65f95275-91f3-4e70-abc5-0d71262c781f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 27820 microversion: 2.20 time: 1.926403 Jan 10 11:42:23.834932 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 385/771] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:21 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 27820 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:23.838154 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-244a5c8e-c8f6-4905-88c2-5068157842c3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:23.846814 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-244a5c8e-c8f6-4905-88c2-5068157842c3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 200 len: 1237 microversion: 2.1 time: 0.076159 Jan 10 11:42:23.847395 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 387/772] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:23 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 1237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:42:24.847376 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-51b077fd-cdc1-4f2c-804d-e57e3b474983 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:24.848677 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-51b077fd-cdc1-4f2c-804d-e57e3b474983 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:24.855820 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-51b077fd-cdc1-4f2c-804d-e57e3b474983 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:24.856283 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-51b077fd-cdc1-4f2c-804d-e57e3b474983 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:24.857090 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-51b077fd-cdc1-4f2c-804d-e57e3b474983 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:24.857532 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-51b077fd-cdc1-4f2c-804d-e57e3b474983 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:24.864011 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-8b165ef4-ed5c-48e1-abbe-231c1b0abd3f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:24.864882 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-8b165ef4-ed5c-48e1-abbe-231c1b0abd3f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:24.871841 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8b165ef4-ed5c-48e1-abbe-231c1b0abd3f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:24.872198 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8b165ef4-ed5c-48e1-abbe-231c1b0abd3f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:24.873837 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8b165ef4-ed5c-48e1-abbe-231c1b0abd3f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:24.874971 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8b165ef4-ed5c-48e1-abbe-231c1b0abd3f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:24.940955 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-51b077fd-cdc1-4f2c-804d-e57e3b474983 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 28182 microversion: 2.20 time: 0.096831 Jan 10 11:42:24.941243 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 386/773] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:24 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 28182 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:24.944902 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-8b165ef4-ed5c-48e1-abbe-231c1b0abd3f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:24.953908 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-8b165ef4-ed5c-48e1-abbe-231c1b0abd3f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 200 len: 1241 microversion: 2.1 time: 0.093809 Jan 10 11:42:24.954528 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 388/774] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:24 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:42:25.955241 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e7ed0f13-3d8a-4e2a-9a68-d972568e2f3e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:25.956324 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e7ed0f13-3d8a-4e2a-9a68-d972568e2f3e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:25.971032 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e7ed0f13-3d8a-4e2a-9a68-d972568e2f3e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:25.971775 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e7ed0f13-3d8a-4e2a-9a68-d972568e2f3e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:25.971910 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-160422e0-d981-4538-94c6-491e84a3346d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:25.972446 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-160422e0-d981-4538-94c6-491e84a3346d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:25.973386 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e7ed0f13-3d8a-4e2a-9a68-d972568e2f3e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:25.973988 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e7ed0f13-3d8a-4e2a-9a68-d972568e2f3e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:25.984822 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-160422e0-d981-4538-94c6-491e84a3346d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:25.985461 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-160422e0-d981-4538-94c6-491e84a3346d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:25.995794 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-160422e0-d981-4538-94c6-491e84a3346d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:25.998902 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-160422e0-d981-4538-94c6-491e84a3346d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:26.067776 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e7ed0f13-3d8a-4e2a-9a68-d972568e2f3e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 28197 microversion: 2.20 time: 0.118051 Jan 10 11:42:26.068883 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 387/775] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:25 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 28197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 11:42:26.131221 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-160422e0-d981-4538-94c6-491e84a3346d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:26.140853 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-160422e0-d981-4538-94c6-491e84a3346d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 200 len: 1297 microversion: 2.1 time: 0.172786 Jan 10 11:42:26.141770 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 389/776] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:25 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 1297 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:42:27.082624 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-79c3590d-d080-49ec-8fbc-960792f86e49 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:27.083871 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-79c3590d-d080-49ec-8fbc-960792f86e49 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:27.100376 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-79c3590d-d080-49ec-8fbc-960792f86e49 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:27.100961 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-79c3590d-d080-49ec-8fbc-960792f86e49 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:27.102074 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-79c3590d-d080-49ec-8fbc-960792f86e49 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:27.103168 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-79c3590d-d080-49ec-8fbc-960792f86e49 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:27.158763 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-c592c795-34a2-4ad6-b295-d1bbf03a5858 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:27.159461 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-c592c795-34a2-4ad6-b295-d1bbf03a5858 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:27.168237 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c592c795-34a2-4ad6-b295-d1bbf03a5858 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:27.171245 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c592c795-34a2-4ad6-b295-d1bbf03a5858 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:27.172236 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c592c795-34a2-4ad6-b295-d1bbf03a5858 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:27.172846 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c592c795-34a2-4ad6-b295-d1bbf03a5858 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:27.195982 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-79c3590d-d080-49ec-8fbc-960792f86e49 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 28473 microversion: 2.20 time: 0.118492 Jan 10 11:42:27.200775 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 388/777] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:27 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 28473 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:27.340489 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-c592c795-34a2-4ad6-b295-d1bbf03a5858 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:27.350014 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-c592c795-34a2-4ad6-b295-d1bbf03a5858 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 200 len: 1363 microversion: 2.1 time: 0.194895 Jan 10 11:42:27.360410 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 390/778] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:27 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:42:28.209084 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-92048e13-25b6-48ee-85ee-1a54607c2228 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:28.211261 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-92048e13-25b6-48ee-85ee-1a54607c2228 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:28.222857 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-92048e13-25b6-48ee-85ee-1a54607c2228 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:28.223755 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-92048e13-25b6-48ee-85ee-1a54607c2228 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:28.224894 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-92048e13-25b6-48ee-85ee-1a54607c2228 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:28.225637 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-92048e13-25b6-48ee-85ee-1a54607c2228 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:28.313999 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-92048e13-25b6-48ee-85ee-1a54607c2228 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 28641 microversion: 2.20 time: 0.109164 Jan 10 11:42:28.314964 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 389/779] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:28 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 28641 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:28.369351 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-87b5e696-434a-44fb-8707-679d39c7152d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:28.435074 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-87b5e696-434a-44fb-8707-679d39c7152d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:28.435074 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-87b5e696-434a-44fb-8707-679d39c7152d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:28.435074 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-87b5e696-434a-44fb-8707-679d39c7152d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:28.435074 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-87b5e696-434a-44fb-8707-679d39c7152d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:28.435502 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-87b5e696-434a-44fb-8707-679d39c7152d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:28.550371 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-87b5e696-434a-44fb-8707-679d39c7152d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:28.559709 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-87b5e696-434a-44fb-8707-679d39c7152d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 200 len: 1363 microversion: 2.1 time: 0.194746 Jan 10 11:42:28.560243 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 391/780] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:28 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:42:28.655696 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-2de3294c-8f6a-403c-8120-3514979d2ace req-dc140d08-3dab-45b0-9a97-91964cf65911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68f610f-6b78-43a7-93b9-398074034ffe", "tag": "2c489974-fd34-47ea-ba59-02a172d3541e"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:28.658667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:42:28.658667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:42:28.675176 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-2de3294c-8f6a-403c-8120-3514979d2ace req-dc140d08-3dab-45b0-9a97-91964cf65911 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:28.675463 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-2de3294c-8f6a-403c-8120-3514979d2ace req-dc140d08-3dab-45b0-9a97-91964cf65911 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:28.697445 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-2de3294c-8f6a-403c-8120-3514979d2ace req-dc140d08-3dab-45b0-9a97-91964cf65911 service nova] Creating event network-changed:2c489974-fd34-47ea-ba59-02a172d3541e for instance b68f610f-6b78-43a7-93b9-398074034ffe on hv-cinder-maste Jan 10 11:42:28.708287 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-2de3294c-8f6a-403c-8120-3514979d2ace req-dc140d08-3dab-45b0-9a97-91964cf65911 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062568 Jan 10 11:42:28.710043 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 390/781] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:42:29.445873 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2a9ec66a-85ed-4b16-a86b-442e75d5299a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:29.447839 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2a9ec66a-85ed-4b16-a86b-442e75d5299a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:29.455135 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a9ec66a-85ed-4b16-a86b-442e75d5299a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:29.456477 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a9ec66a-85ed-4b16-a86b-442e75d5299a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:29.457936 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a9ec66a-85ed-4b16-a86b-442e75d5299a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:29.458606 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2a9ec66a-85ed-4b16-a86b-442e75d5299a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:29.548378 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2a9ec66a-85ed-4b16-a86b-442e75d5299a tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 28641 microversion: 2.20 time: 0.106714 Jan 10 11:42:29.557254 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 392/782] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:29 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 28641 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 10 11:42:29.578681 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b0563154-ec7e-4c39-a898-f41cb43f07dd tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:29.579409 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b0563154-ec7e-4c39-a898-f41cb43f07dd tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:29.586690 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b0563154-ec7e-4c39-a898-f41cb43f07dd tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:29.588839 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b0563154-ec7e-4c39-a898-f41cb43f07dd tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:29.588839 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b0563154-ec7e-4c39-a898-f41cb43f07dd tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:29.588839 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b0563154-ec7e-4c39-a898-f41cb43f07dd tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:29.946636 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b0563154-ec7e-4c39-a898-f41cb43f07dd tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:29.957973 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b0563154-ec7e-4c39-a898-f41cb43f07dd tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 200 len: 1363 microversion: 2.1 time: 0.384701 Jan 10 11:42:29.958601 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 391/783] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:29 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 1363 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:30.563766 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d60bd86a-76e0-40e4-8f46-aaf313987712 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:30.564796 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d60bd86a-76e0-40e4-8f46-aaf313987712 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:30.572217 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d60bd86a-76e0-40e4-8f46-aaf313987712 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:30.572908 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d60bd86a-76e0-40e4-8f46-aaf313987712 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:30.574437 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d60bd86a-76e0-40e4-8f46-aaf313987712 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:30.574877 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d60bd86a-76e0-40e4-8f46-aaf313987712 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:30.646654 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d60bd86a-76e0-40e4-8f46-aaf313987712 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 28641 microversion: 2.20 time: 0.086770 Jan 10 11:42:30.648144 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 393/784] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:30 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 28641 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:30.978790 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-583b94f2-5c26-4dde-a14f-bec6d0fdc93c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:30.987702 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-583b94f2-5c26-4dde-a14f-bec6d0fdc93c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:30.998811 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-583b94f2-5c26-4dde-a14f-bec6d0fdc93c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:30.999937 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-583b94f2-5c26-4dde-a14f-bec6d0fdc93c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:31.001042 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-583b94f2-5c26-4dde-a14f-bec6d0fdc93c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:31.001632 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-583b94f2-5c26-4dde-a14f-bec6d0fdc93c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:31.178766 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-583b94f2-5c26-4dde-a14f-bec6d0fdc93c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:31.187765 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-583b94f2-5c26-4dde-a14f-bec6d0fdc93c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 200 len: 1363 microversion: 2.1 time: 0.213598 Jan 10 11:42:31.188633 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 392/785] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:30 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:31.660894 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-da81b3d2-2915-4f71-a1bf-a8494a101ba5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:31.662937 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-da81b3d2-2915-4f71-a1bf-a8494a101ba5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:31.671535 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-da81b3d2-2915-4f71-a1bf-a8494a101ba5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:31.672589 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-da81b3d2-2915-4f71-a1bf-a8494a101ba5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:31.673647 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-da81b3d2-2915-4f71-a1bf-a8494a101ba5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:31.674304 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-da81b3d2-2915-4f71-a1bf-a8494a101ba5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:31.774121 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-da81b3d2-2915-4f71-a1bf-a8494a101ba5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 29375 microversion: 2.20 time: 0.117556 Jan 10 11:42:31.775873 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 394/786] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:31 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 29375 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:32.218323 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-77672b41-ed91-456f-87e4-385c8beb6dca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:32.222172 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-77672b41-ed91-456f-87e4-385c8beb6dca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:32.235994 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-77672b41-ed91-456f-87e4-385c8beb6dca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:32.236859 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-77672b41-ed91-456f-87e4-385c8beb6dca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:32.237946 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-77672b41-ed91-456f-87e4-385c8beb6dca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:32.238423 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-77672b41-ed91-456f-87e4-385c8beb6dca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:32.459103 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-77672b41-ed91-456f-87e4-385c8beb6dca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:32.473736 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-77672b41-ed91-456f-87e4-385c8beb6dca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 200 len: 1363 microversion: 2.1 time: 0.269238 Jan 10 11:42:32.486307 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 393/787] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:32 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:42:32.791295 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-adab965e-84bf-4a53-9c05-0741e2bd862b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:32.793096 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-adab965e-84bf-4a53-9c05-0741e2bd862b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:32.801209 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-adab965e-84bf-4a53-9c05-0741e2bd862b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:32.802109 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-adab965e-84bf-4a53-9c05-0741e2bd862b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:32.803284 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-adab965e-84bf-4a53-9c05-0741e2bd862b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:32.803752 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-adab965e-84bf-4a53-9c05-0741e2bd862b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:32.896949 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-adab965e-84bf-4a53-9c05-0741e2bd862b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 31021 microversion: 2.20 time: 0.110962 Jan 10 11:42:32.897662 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 395/788] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:32 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 31021 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:33.505130 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-bc0a48d8-d097-4cd9-af77-1ffcd4ac27e1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:33.505849 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-bc0a48d8-d097-4cd9-af77-1ffcd4ac27e1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:33.515137 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bc0a48d8-d097-4cd9-af77-1ffcd4ac27e1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:33.515719 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bc0a48d8-d097-4cd9-af77-1ffcd4ac27e1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:33.516595 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bc0a48d8-d097-4cd9-af77-1ffcd4ac27e1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:33.517294 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bc0a48d8-d097-4cd9-af77-1ffcd4ac27e1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:33.661618 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-bc0a48d8-d097-4cd9-af77-1ffcd4ac27e1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:33.674888 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-bc0a48d8-d097-4cd9-af77-1ffcd4ac27e1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 200 len: 1363 microversion: 2.1 time: 0.178966 Jan 10 11:42:33.675961 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 394/789] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:33 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:33.911120 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f615ee8a-9f9d-422a-8344-aec7398c6b34 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:33.921122 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f615ee8a-9f9d-422a-8344-aec7398c6b34 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:33.934526 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f615ee8a-9f9d-422a-8344-aec7398c6b34 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:33.935386 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f615ee8a-9f9d-422a-8344-aec7398c6b34 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:33.936442 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f615ee8a-9f9d-422a-8344-aec7398c6b34 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:33.937090 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f615ee8a-9f9d-422a-8344-aec7398c6b34 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:34.024720 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f615ee8a-9f9d-422a-8344-aec7398c6b34 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 32751 microversion: 2.20 time: 0.117933 Jan 10 11:42:34.026004 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 396/790] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:33 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 32751 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:34.249023 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-b788e46a-8164-42c4-86ed-03cd37ea3328 req-577f7232-9da8-46e7-8f8b-e749c514a8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68f610f-6b78-43a7-93b9-398074034ffe", "name": "network-vif-plugged", "status": "completed", "tag": "2c489974-fd34-47ea-ba59-02a172d3541e"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:34.251039 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:42:34.251039 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:42:34.260815 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-b788e46a-8164-42c4-86ed-03cd37ea3328 req-577f7232-9da8-46e7-8f8b-e749c514a8a2 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:34.261515 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-b788e46a-8164-42c4-86ed-03cd37ea3328 req-577f7232-9da8-46e7-8f8b-e749c514a8a2 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:34.273467 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-b788e46a-8164-42c4-86ed-03cd37ea3328 req-577f7232-9da8-46e7-8f8b-e749c514a8a2 service nova] Creating event network-vif-plugged:2c489974-fd34-47ea-ba59-02a172d3541e for instance b68f610f-6b78-43a7-93b9-398074034ffe on hv-cinder-maste Jan 10 11:42:34.279068 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-b788e46a-8164-42c4-86ed-03cd37ea3328 req-577f7232-9da8-46e7-8f8b-e749c514a8a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034889 Jan 10 11:42:34.279888 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 395/791] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:42:34.701972 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-6c2661b6-f3b1-45ce-8e90-a329d094a77d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:34.703976 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-6c2661b6-f3b1-45ce-8e90-a329d094a77d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:34.714003 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6c2661b6-f3b1-45ce-8e90-a329d094a77d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:34.714929 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6c2661b6-f3b1-45ce-8e90-a329d094a77d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:34.716678 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6c2661b6-f3b1-45ce-8e90-a329d094a77d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:34.717497 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6c2661b6-f3b1-45ce-8e90-a329d094a77d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:34.929177 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-6c2661b6-f3b1-45ce-8e90-a329d094a77d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:34.938467 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-6c2661b6-f3b1-45ce-8e90-a329d094a77d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 200 len: 1363 microversion: 2.1 time: 0.244465 Jan 10 11:42:34.939397 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 397/792] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:34 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:35.039887 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7803c8be-6822-405a-8f37-e465cdd6229b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:35.040920 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7803c8be-6822-405a-8f37-e465cdd6229b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:35.050604 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7803c8be-6822-405a-8f37-e465cdd6229b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:35.051066 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7803c8be-6822-405a-8f37-e465cdd6229b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:35.051856 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7803c8be-6822-405a-8f37-e465cdd6229b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:35.052294 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7803c8be-6822-405a-8f37-e465cdd6229b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:35.137809 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7803c8be-6822-405a-8f37-e465cdd6229b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 33656 microversion: 2.20 time: 0.102068 Jan 10 11:42:35.138504 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 396/793] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:35 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 33656 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:35.955566 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-8b623b4b-a9f8-4774-9e10-0bad5f943ed9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:35.960723 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-8b623b4b-a9f8-4774-9e10-0bad5f943ed9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:35.963465 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8b623b4b-a9f8-4774-9e10-0bad5f943ed9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:35.963926 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8b623b4b-a9f8-4774-9e10-0bad5f943ed9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:35.974833 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8b623b4b-a9f8-4774-9e10-0bad5f943ed9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:35.975345 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8b623b4b-a9f8-4774-9e10-0bad5f943ed9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:36.158413 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-8b623b4b-a9f8-4774-9e10-0bad5f943ed9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:36.162194 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-eb5e0e14-5f2a-4e9d-a1cd-51119ff18cdb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:36.165928 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-eb5e0e14-5f2a-4e9d-a1cd-51119ff18cdb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:36.177270 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-8b623b4b-a9f8-4774-9e10-0bad5f943ed9 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 200 len: 1363 microversion: 2.1 time: 0.225070 Jan 10 11:42:36.178505 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 398/794] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:35 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:36.179781 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-eb5e0e14-5f2a-4e9d-a1cd-51119ff18cdb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:36.180437 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-eb5e0e14-5f2a-4e9d-a1cd-51119ff18cdb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:36.181432 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-eb5e0e14-5f2a-4e9d-a1cd-51119ff18cdb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:36.182039 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-eb5e0e14-5f2a-4e9d-a1cd-51119ff18cdb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:36.268610 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-eb5e0e14-5f2a-4e9d-a1cd-51119ff18cdb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 34474 microversion: 2.20 time: 0.121846 Jan 10 11:42:36.270086 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 397/795] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:36 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 34474 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:37.207572 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ea79f2b6-e9a7-4728-8cec-3f0c8fbc8479 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:37.208339 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ea79f2b6-e9a7-4728-8cec-3f0c8fbc8479 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:37.220429 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ea79f2b6-e9a7-4728-8cec-3f0c8fbc8479 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:37.221699 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ea79f2b6-e9a7-4728-8cec-3f0c8fbc8479 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:37.223799 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ea79f2b6-e9a7-4728-8cec-3f0c8fbc8479 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:37.224551 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ea79f2b6-e9a7-4728-8cec-3f0c8fbc8479 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:37.294081 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e9a8bb08-88f8-4e25-b4a7-4dce4e4a5af2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:37.296142 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e9a8bb08-88f8-4e25-b4a7-4dce4e4a5af2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:37.317414 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e9a8bb08-88f8-4e25-b4a7-4dce4e4a5af2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:37.318203 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e9a8bb08-88f8-4e25-b4a7-4dce4e4a5af2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:37.324277 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e9a8bb08-88f8-4e25-b4a7-4dce4e4a5af2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:37.325031 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e9a8bb08-88f8-4e25-b4a7-4dce4e4a5af2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:37.431292 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e9a8bb08-88f8-4e25-b4a7-4dce4e4a5af2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 35541 microversion: 2.20 time: 0.150545 Jan 10 11:42:37.440562 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 398/796] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:37 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 35541 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:37.462611 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ea79f2b6-e9a7-4728-8cec-3f0c8fbc8479 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:37.475598 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ea79f2b6-e9a7-4728-8cec-3f0c8fbc8479 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 200 len: 1548 microversion: 2.1 time: 0.274503 Jan 10 11:42:37.476385 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 399/797] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:42:37 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 1548 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:37.497731 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-86197cdc-57d7-466a-a118-ee2070d79caf tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:37.500657 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-86197cdc-57d7-466a-a118-ee2070d79caf tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:37.525367 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-86197cdc-57d7-466a-a118-ee2070d79caf tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:37.526564 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-86197cdc-57d7-466a-a118-ee2070d79caf tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:37.527656 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-86197cdc-57d7-466a-a118-ee2070d79caf tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:37.528402 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-86197cdc-57d7-466a-a118-ee2070d79caf tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:37.626550 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-86197cdc-57d7-466a-a118-ee2070d79caf tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136863 Jan 10 11:42:37.627343 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 399/798] 10.222.0.20 () {58 vars in 1274 bytes} [Mon Jan 10 11:42:37 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:42:38.448037 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-007e5c7d-e168-45de-97a3-3319d2dc45e2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:38.449525 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-007e5c7d-e168-45de-97a3-3319d2dc45e2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:38.456028 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-007e5c7d-e168-45de-97a3-3319d2dc45e2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:38.462038 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-007e5c7d-e168-45de-97a3-3319d2dc45e2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:38.462038 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-007e5c7d-e168-45de-97a3-3319d2dc45e2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:38.462038 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-007e5c7d-e168-45de-97a3-3319d2dc45e2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:38.530262 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-007e5c7d-e168-45de-97a3-3319d2dc45e2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 37007 microversion: 2.20 time: 0.085624 Jan 10 11:42:38.530873 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 400/799] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:38 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 37007 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:39.086933 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-77a9e5ff-2e17-4d14-bfda-9d52644317a1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:39.088754 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-77a9e5ff-2e17-4d14-bfda-9d52644317a1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:39.099412 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-b8d51505-d9e0-4fd6-b29f-a42819db24a0 req-578b6793-ac9d-4109-8ba6-df3604551726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b68f610f-6b78-43a7-93b9-398074034ffe", "tag": "2c489974-fd34-47ea-ba59-02a172d3541e"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:39.100949 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:42:39.100949 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:42:39.102765 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-77a9e5ff-2e17-4d14-bfda-9d52644317a1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:39.103229 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-77a9e5ff-2e17-4d14-bfda-9d52644317a1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:39.104037 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-77a9e5ff-2e17-4d14-bfda-9d52644317a1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:39.104484 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-77a9e5ff-2e17-4d14-bfda-9d52644317a1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:39.109482 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-b8d51505-d9e0-4fd6-b29f-a42819db24a0 req-578b6793-ac9d-4109-8ba6-df3604551726 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:39.110177 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-b8d51505-d9e0-4fd6-b29f-a42819db24a0 req-578b6793-ac9d-4109-8ba6-df3604551726 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:39.124787 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-b8d51505-d9e0-4fd6-b29f-a42819db24a0 req-578b6793-ac9d-4109-8ba6-df3604551726 service nova] Creating event network-changed:2c489974-fd34-47ea-ba59-02a172d3541e for instance b68f610f-6b78-43a7-93b9-398074034ffe on hv-cinder-maste Jan 10 11:42:39.137866 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-b8d51505-d9e0-4fd6-b29f-a42819db24a0 req-578b6793-ac9d-4109-8ba6-df3604551726 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042316 Jan 10 11:42:39.139162 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 401/800] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:42:39.204385 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-77a9e5ff-2e17-4d14-bfda-9d52644317a1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 14 microversion: 2.1 time: 0.121642 Jan 10 11:42:39.205501 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 400/801] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:39 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:42:39.697956 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a8afe7bb-8e1a-421f-99da-83faef776ef8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:39.699197 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a8afe7bb-8e1a-421f-99da-83faef776ef8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:39.708243 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a8afe7bb-8e1a-421f-99da-83faef776ef8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:39.708763 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a8afe7bb-8e1a-421f-99da-83faef776ef8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:39.709830 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a8afe7bb-8e1a-421f-99da-83faef776ef8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:39.710502 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a8afe7bb-8e1a-421f-99da-83faef776ef8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:39.796907 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a8afe7bb-8e1a-421f-99da-83faef776ef8 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 38187 microversion: 2.20 time: 0.258179 Jan 10 11:42:39.805473 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 402/802] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:39 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 38187 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:40.217116 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-db9ee863-d910-485c-aaf5-3602130a3cd0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:40.218907 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-db9ee863-d910-485c-aaf5-3602130a3cd0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:40.227552 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-db9ee863-d910-485c-aaf5-3602130a3cd0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:40.231512 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-db9ee863-d910-485c-aaf5-3602130a3cd0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:40.232657 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-db9ee863-d910-485c-aaf5-3602130a3cd0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:40.233305 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-db9ee863-d910-485c-aaf5-3602130a3cd0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:40.316058 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-db9ee863-d910-485c-aaf5-3602130a3cd0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 14 microversion: 2.1 time: 0.103407 Jan 10 11:42:40.317369 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 401/803] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:40 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:42:40.820898 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-c26f3507-ec73-41ba-b5b8-f3e131d2550b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:40.822023 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-c26f3507-ec73-41ba-b5b8-f3e131d2550b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:40.832365 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c26f3507-ec73-41ba-b5b8-f3e131d2550b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:40.832365 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c26f3507-ec73-41ba-b5b8-f3e131d2550b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:40.833087 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c26f3507-ec73-41ba-b5b8-f3e131d2550b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:40.833759 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c26f3507-ec73-41ba-b5b8-f3e131d2550b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:40.912839 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-c26f3507-ec73-41ba-b5b8-f3e131d2550b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 38187 microversion: 2.20 time: 0.097873 Jan 10 11:42:40.919023 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 403/804] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:40 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 38187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:41.334508 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-9a482a28-6ec6-4726-be24-3f507c1f2e48 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:41.336456 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-9a482a28-6ec6-4726-be24-3f507c1f2e48 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:41.344237 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9a482a28-6ec6-4726-be24-3f507c1f2e48 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:41.344683 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9a482a28-6ec6-4726-be24-3f507c1f2e48 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:41.345489 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9a482a28-6ec6-4726-be24-3f507c1f2e48 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:41.345917 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9a482a28-6ec6-4726-be24-3f507c1f2e48 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:41.433995 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-9a482a28-6ec6-4726-be24-3f507c1f2e48 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 14 microversion: 2.1 time: 0.106190 Jan 10 11:42:41.434781 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 402/805] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:41 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 10 11:42:41.927120 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-79d1d42a-c1f6-4cce-bbe1-eadb44bbaff4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:41.937215 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-79d1d42a-c1f6-4cce-bbe1-eadb44bbaff4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:41.945526 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-79d1d42a-c1f6-4cce-bbe1-eadb44bbaff4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:41.946253 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-79d1d42a-c1f6-4cce-bbe1-eadb44bbaff4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:41.947412 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-79d1d42a-c1f6-4cce-bbe1-eadb44bbaff4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:41.960875 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-79d1d42a-c1f6-4cce-bbe1-eadb44bbaff4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:42.038058 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-79d1d42a-c1f6-4cce-bbe1-eadb44bbaff4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 38187 microversion: 2.20 time: 0.115053 Jan 10 11:42:42.045897 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 404/806] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:41 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 38187 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:42.445794 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8932af09-81ba-499d-ae53-9ec9eebffb80 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:42.446866 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-8932af09-81ba-499d-ae53-9ec9eebffb80 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:42.455550 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8932af09-81ba-499d-ae53-9ec9eebffb80 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:42.456012 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8932af09-81ba-499d-ae53-9ec9eebffb80 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:42.456823 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8932af09-81ba-499d-ae53-9ec9eebffb80 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:42.457266 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8932af09-81ba-499d-ae53-9ec9eebffb80 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:42.519771 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-8932af09-81ba-499d-ae53-9ec9eebffb80 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 14 microversion: 2.1 time: 0.077998 Jan 10 11:42:42.520444 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 403/807] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:42 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:42:43.053118 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e73b4018-8e8b-4ca1-b22d-ad63408ba927 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:43.054185 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-e73b4018-8e8b-4ca1-b22d-ad63408ba927 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:43.061767 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e73b4018-8e8b-4ca1-b22d-ad63408ba927 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:43.062238 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e73b4018-8e8b-4ca1-b22d-ad63408ba927 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:43.063042 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e73b4018-8e8b-4ca1-b22d-ad63408ba927 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:43.063485 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e73b4018-8e8b-4ca1-b22d-ad63408ba927 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:43.132599 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-e73b4018-8e8b-4ca1-b22d-ad63408ba927 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 38187 microversion: 2.20 time: 0.083351 Jan 10 11:42:43.133254 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 405/808] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:43 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 38187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:43.530357 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-48465feb-9282-4d61-94fe-36c3e4792577 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:43.531388 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-48465feb-9282-4d61-94fe-36c3e4792577 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:43.538198 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-48465feb-9282-4d61-94fe-36c3e4792577 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:43.538673 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-48465feb-9282-4d61-94fe-36c3e4792577 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:43.539452 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-48465feb-9282-4d61-94fe-36c3e4792577 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:43.539890 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-48465feb-9282-4d61-94fe-36c3e4792577 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:43.601192 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-48465feb-9282-4d61-94fe-36c3e4792577 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 14 microversion: 2.1 time: 0.074927 Jan 10 11:42:43.601809 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 404/809] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:43 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:42:44.145469 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-c49f3788-4d91-4dd1-81f2-b0b205f2ed07 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:44.146569 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-c49f3788-4d91-4dd1-81f2-b0b205f2ed07 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:44.154279 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c49f3788-4d91-4dd1-81f2-b0b205f2ed07 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:44.154736 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c49f3788-4d91-4dd1-81f2-b0b205f2ed07 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:44.155530 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c49f3788-4d91-4dd1-81f2-b0b205f2ed07 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:44.155967 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c49f3788-4d91-4dd1-81f2-b0b205f2ed07 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:44.226686 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-c49f3788-4d91-4dd1-81f2-b0b205f2ed07 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 200 len: 38328 microversion: 2.20 time: 0.085010 Jan 10 11:42:44.227654 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 406/810] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:44 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 38328 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:42:44.240791 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-de878241-b469-4982-a84a-a2dfaf000781 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:44.241370 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-de878241-b469-4982-a84a-a2dfaf000781 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:44.248156 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-de878241-b469-4982-a84a-a2dfaf000781 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:44.248611 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-de878241-b469-4982-a84a-a2dfaf000781 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:44.249391 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-de878241-b469-4982-a84a-a2dfaf000781 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:44.249826 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-de878241-b469-4982-a84a-a2dfaf000781 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:44.275982 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-de878241-b469-4982-a84a-a2dfaf000781 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/ips" status: 200 len: 152 microversion: 2.20 time: 0.040733 Jan 10 11:42:44.276560 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 405/811] 10.222.0.20 () {60 vars in 1288 bytes} [Mon Jan 10 11:42:44 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:42:44.668562 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-70146447-af0e-4773-a39b-39388216b057 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:44.669604 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-70146447-af0e-4773-a39b-39388216b057 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:44.676422 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-70146447-af0e-4773-a39b-39388216b057 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:44.676867 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-70146447-af0e-4773-a39b-39388216b057 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:44.677645 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-70146447-af0e-4773-a39b-39388216b057 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:44.678076 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-70146447-af0e-4773-a39b-39388216b057 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:44.738417 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-70146447-af0e-4773-a39b-39388216b057 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 14 microversion: 2.1 time: 0.129453 Jan 10 11:42:44.742439 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 407/812] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:44 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:42:45.751620 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f88738bc-6ea4-42c3-b76b-8247bcb7fb1d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:45.753009 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f88738bc-6ea4-42c3-b76b-8247bcb7fb1d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:45.760584 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f88738bc-6ea4-42c3-b76b-8247bcb7fb1d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:45.761035 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f88738bc-6ea4-42c3-b76b-8247bcb7fb1d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:45.762491 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f88738bc-6ea4-42c3-b76b-8247bcb7fb1d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:45.763007 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f88738bc-6ea4-42c3-b76b-8247bcb7fb1d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:45.825324 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f88738bc-6ea4-42c3-b76b-8247bcb7fb1d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 14 microversion: 2.1 time: 0.077455 Jan 10 11:42:45.825999 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 406/813] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:45 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:42:46.614262 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-cfcb9c39-5947-4f9e-8d2c-756c2aad7466 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:46.615155 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-cfcb9c39-5947-4f9e-8d2c-756c2aad7466 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:46.623366 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cfcb9c39-5947-4f9e-8d2c-756c2aad7466 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:46.623811 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cfcb9c39-5947-4f9e-8d2c-756c2aad7466 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:46.624606 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cfcb9c39-5947-4f9e-8d2c-756c2aad7466 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:46.625036 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cfcb9c39-5947-4f9e-8d2c-756c2aad7466 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:46.649180 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-cfcb9c39-5947-4f9e-8d2c-756c2aad7466 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lazy-loading 'flavor' on Instance uuid 70029374-0ab3-49b9-880e-6a102761c463 {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:42:46.836789 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f1369498-c30b-4c72-b199-831195f9e850 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:46.837798 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f1369498-c30b-4c72-b199-831195f9e850 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:46.845905 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f1369498-c30b-4c72-b199-831195f9e850 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:46.846494 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f1369498-c30b-4c72-b199-831195f9e850 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:46.847304 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f1369498-c30b-4c72-b199-831195f9e850 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:46.847741 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f1369498-c30b-4c72-b199-831195f9e850 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:46.914021 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f1369498-c30b-4c72-b199-831195f9e850 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 14 microversion: 2.1 time: 0.081215 Jan 10 11:42:46.914897 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 407/814] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:46 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 10 11:42:47.339226 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-cfcb9c39-5947-4f9e-8d2c-756c2aad7466 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 202 len: 0 microversion: 2.20 time: 0.729267 Jan 10 11:42:47.340019 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 408/815] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:42:46 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 0 bytes in 731 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:42:47.349087 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7ebfddf7-2026-4ec0-a793-36f5fff34e1f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:47.350150 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7ebfddf7-2026-4ec0-a793-36f5fff34e1f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:47.357587 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7ebfddf7-2026-4ec0-a793-36f5fff34e1f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:47.358045 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7ebfddf7-2026-4ec0-a793-36f5fff34e1f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:47.358885 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7ebfddf7-2026-4ec0-a793-36f5fff34e1f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:47.359330 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7ebfddf7-2026-4ec0-a793-36f5fff34e1f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:47.506762 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7ebfddf7-2026-4ec0-a793-36f5fff34e1f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:47.515657 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7ebfddf7-2026-4ec0-a793-36f5fff34e1f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:47.517185 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7ebfddf7-2026-4ec0-a793-36f5fff34e1f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:47.518391 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7ebfddf7-2026-4ec0-a793-36f5fff34e1f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1724 microversion: 2.20 time: 0.173692 Jan 10 11:42:47.518958 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 408/816] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:42:47 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:42:47.926330 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-edc77677-ad89-4354-a991-b1261867d1f4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:47.927370 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-edc77677-ad89-4354-a991-b1261867d1f4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:47.937143 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-edc77677-ad89-4354-a991-b1261867d1f4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:47.937599 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-edc77677-ad89-4354-a991-b1261867d1f4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:47.938477 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-edc77677-ad89-4354-a991-b1261867d1f4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:47.938933 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-edc77677-ad89-4354-a991-b1261867d1f4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:48.001922 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-edc77677-ad89-4354-a991-b1261867d1f4 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 14 microversion: 2.1 time: 0.080101 Jan 10 11:42:48.005075 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 409/817] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:47 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:42:48.536637 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-1fe4f5f3-4969-4c10-8942-4db6e6417497 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:48.537249 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-1fe4f5f3-4969-4c10-8942-4db6e6417497 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:48.543663 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1fe4f5f3-4969-4c10-8942-4db6e6417497 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:48.544115 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1fe4f5f3-4969-4c10-8942-4db6e6417497 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:48.544911 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1fe4f5f3-4969-4c10-8942-4db6e6417497 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:48.545353 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1fe4f5f3-4969-4c10-8942-4db6e6417497 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:48.688242 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-1fe4f5f3-4969-4c10-8942-4db6e6417497 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:48.696212 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-1fe4f5f3-4969-4c10-8942-4db6e6417497 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:48.697724 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-1fe4f5f3-4969-4c10-8942-4db6e6417497 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:48.698907 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-1fe4f5f3-4969-4c10-8942-4db6e6417497 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1724 microversion: 2.20 time: 0.165959 Jan 10 11:42:48.699642 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 409/818] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:42:48 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:42:49.013993 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a5e39fc4-70a7-4a37-9d73-ba0b165e4203 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:49.015038 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a5e39fc4-70a7-4a37-9d73-ba0b165e4203 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:49.022094 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a5e39fc4-70a7-4a37-9d73-ba0b165e4203 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:49.022572 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a5e39fc4-70a7-4a37-9d73-ba0b165e4203 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:49.023398 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a5e39fc4-70a7-4a37-9d73-ba0b165e4203 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:49.023840 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a5e39fc4-70a7-4a37-9d73-ba0b165e4203 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:49.096131 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a5e39fc4-70a7-4a37-9d73-ba0b165e4203 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 5590 microversion: 2.1 time: 0.086693 Jan 10 11:42:49.096791 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 410/819] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:49 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 5590 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:42:49.717390 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4673d00f-6647-48ac-9fe0-c64a0e1b7b48 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:49.718002 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4673d00f-6647-48ac-9fe0-c64a0e1b7b48 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:49.724300 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4673d00f-6647-48ac-9fe0-c64a0e1b7b48 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:49.726245 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4673d00f-6647-48ac-9fe0-c64a0e1b7b48 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:49.726245 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4673d00f-6647-48ac-9fe0-c64a0e1b7b48 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:49.726245 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4673d00f-6647-48ac-9fe0-c64a0e1b7b48 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:49.897259 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4673d00f-6647-48ac-9fe0-c64a0e1b7b48 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:49.906997 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4673d00f-6647-48ac-9fe0-c64a0e1b7b48 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:49.908531 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4673d00f-6647-48ac-9fe0-c64a0e1b7b48 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:49.909861 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4673d00f-6647-48ac-9fe0-c64a0e1b7b48 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1724 microversion: 2.20 time: 0.196571 Jan 10 11:42:49.910484 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 410/820] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:42:49 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:42:50.108681 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-189c8e3d-acef-4427-bc65-19e80ca09a70 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:50.109497 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-189c8e3d-acef-4427-bc65-19e80ca09a70 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:50.116940 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-189c8e3d-acef-4427-bc65-19e80ca09a70 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:50.117388 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-189c8e3d-acef-4427-bc65-19e80ca09a70 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:50.118187 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-189c8e3d-acef-4427-bc65-19e80ca09a70 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:50.118647 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-189c8e3d-acef-4427-bc65-19e80ca09a70 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:50.194184 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-189c8e3d-acef-4427-bc65-19e80ca09a70 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 15025 microversion: 2.1 time: 0.090325 Jan 10 11:42:50.194877 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 411/821] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:50 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 15025 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:42:50.928802 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b3b4fc60-dcf1-44cb-a818-27ce3e3508e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:50.929410 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b3b4fc60-dcf1-44cb-a818-27ce3e3508e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:50.937001 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b3b4fc60-dcf1-44cb-a818-27ce3e3508e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:50.937453 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b3b4fc60-dcf1-44cb-a818-27ce3e3508e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:50.938279 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b3b4fc60-dcf1-44cb-a818-27ce3e3508e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:50.938721 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b3b4fc60-dcf1-44cb-a818-27ce3e3508e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:51.079738 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b3b4fc60-dcf1-44cb-a818-27ce3e3508e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:51.087904 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b3b4fc60-dcf1-44cb-a818-27ce3e3508e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:51.089329 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b3b4fc60-dcf1-44cb-a818-27ce3e3508e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:51.091971 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b3b4fc60-dcf1-44cb-a818-27ce3e3508e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1724 microversion: 2.20 time: 0.166957 Jan 10 11:42:51.095311 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 411/822] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:42:50 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:42:51.206793 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-acb1133a-d1d6-4656-9dc4-0dd9d1323cd2 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:51.207803 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-acb1133a-d1d6-4656-9dc4-0dd9d1323cd2 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:51.215582 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-acb1133a-d1d6-4656-9dc4-0dd9d1323cd2 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:51.216037 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-acb1133a-d1d6-4656-9dc4-0dd9d1323cd2 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:51.216840 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-acb1133a-d1d6-4656-9dc4-0dd9d1323cd2 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:51.218501 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-acb1133a-d1d6-4656-9dc4-0dd9d1323cd2 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:51.293305 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-acb1133a-d1d6-4656-9dc4-0dd9d1323cd2 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 18608 microversion: 2.1 time: 0.090141 Jan 10 11:42:51.297494 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 412/823] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:51 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 18608 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:42:52.110929 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-042a3839-817a-4715-bb1f-e07a209177fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:52.111544 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-042a3839-817a-4715-bb1f-e07a209177fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:52.118984 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-042a3839-817a-4715-bb1f-e07a209177fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:52.119594 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-042a3839-817a-4715-bb1f-e07a209177fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:52.120455 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-042a3839-817a-4715-bb1f-e07a209177fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:52.121015 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-042a3839-817a-4715-bb1f-e07a209177fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:52.302016 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-042a3839-817a-4715-bb1f-e07a209177fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:52.306429 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9ba1b74d-070d-4f67-88c4-9f633c641c9c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:52.307446 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9ba1b74d-070d-4f67-88c4-9f633c641c9c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:52.310474 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-042a3839-817a-4715-bb1f-e07a209177fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:52.312288 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-042a3839-817a-4715-bb1f-e07a209177fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:52.313475 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-042a3839-817a-4715-bb1f-e07a209177fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1724 microversion: 2.20 time: 0.206546 Jan 10 11:42:52.314453 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9ba1b74d-070d-4f67-88c4-9f633c641c9c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:52.314597 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 412/824] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:42:52 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:42:52.315263 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9ba1b74d-070d-4f67-88c4-9f633c641c9c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:52.316068 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9ba1b74d-070d-4f67-88c4-9f633c641c9c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:52.316666 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9ba1b74d-070d-4f67-88c4-9f633c641c9c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:52.404549 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9ba1b74d-070d-4f67-88c4-9f633c641c9c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 19893 microversion: 2.1 time: 0.102443 Jan 10 11:42:52.405312 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 413/825] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:52 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 19893 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:42:53.336653 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f4c6453f-66b5-4ae9-b3cc-fdc52259a3fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:53.337359 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f4c6453f-66b5-4ae9-b3cc-fdc52259a3fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:53.345342 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f4c6453f-66b5-4ae9-b3cc-fdc52259a3fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:53.345803 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f4c6453f-66b5-4ae9-b3cc-fdc52259a3fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:53.346665 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f4c6453f-66b5-4ae9-b3cc-fdc52259a3fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:53.347223 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f4c6453f-66b5-4ae9-b3cc-fdc52259a3fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:53.417278 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e77aa62b-1d46-4f37-89ea-1e9f8a22f5f0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:53.418406 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-e77aa62b-1d46-4f37-89ea-1e9f8a22f5f0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:53.429835 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e77aa62b-1d46-4f37-89ea-1e9f8a22f5f0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:53.430328 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e77aa62b-1d46-4f37-89ea-1e9f8a22f5f0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:53.431143 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e77aa62b-1d46-4f37-89ea-1e9f8a22f5f0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:53.431589 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e77aa62b-1d46-4f37-89ea-1e9f8a22f5f0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:53.523382 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-e77aa62b-1d46-4f37-89ea-1e9f8a22f5f0 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 22666 microversion: 2.1 time: 0.110157 Jan 10 11:42:53.524308 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 414/826] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:53 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 22666 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:42:53.528728 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f4c6453f-66b5-4ae9-b3cc-fdc52259a3fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:53.537617 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f4c6453f-66b5-4ae9-b3cc-fdc52259a3fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:53.539908 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f4c6453f-66b5-4ae9-b3cc-fdc52259a3fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:53.541143 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f4c6453f-66b5-4ae9-b3cc-fdc52259a3fb tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1724 microversion: 2.20 time: 0.211369 Jan 10 11:42:53.541719 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 413/827] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:42:53 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:42:54.537278 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f5cdaa72-7c44-4361-a7e2-b980ff2a4dc3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:54.539179 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f5cdaa72-7c44-4361-a7e2-b980ff2a4dc3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:54.547643 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f5cdaa72-7c44-4361-a7e2-b980ff2a4dc3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:54.548062 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f5cdaa72-7c44-4361-a7e2-b980ff2a4dc3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:54.548901 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f5cdaa72-7c44-4361-a7e2-b980ff2a4dc3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:54.549336 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f5cdaa72-7c44-4361-a7e2-b980ff2a4dc3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:54.561911 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-1e88b719-0fb8-4d41-9b12-fc39215fcc56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:54.563590 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-1e88b719-0fb8-4d41-9b12-fc39215fcc56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:54.573317 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1e88b719-0fb8-4d41-9b12-fc39215fcc56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:54.573782 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1e88b719-0fb8-4d41-9b12-fc39215fcc56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:54.575145 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1e88b719-0fb8-4d41-9b12-fc39215fcc56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:54.575756 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1e88b719-0fb8-4d41-9b12-fc39215fcc56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:54.642377 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f5cdaa72-7c44-4361-a7e2-b980ff2a4dc3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 24082 microversion: 2.1 time: 0.109356 Jan 10 11:42:54.643197 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 415/828] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:54 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 24082 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:42:54.764220 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-1e88b719-0fb8-4d41-9b12-fc39215fcc56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:54.777243 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-1e88b719-0fb8-4d41-9b12-fc39215fcc56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:54.780324 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-1e88b719-0fb8-4d41-9b12-fc39215fcc56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:54.781882 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-1e88b719-0fb8-4d41-9b12-fc39215fcc56 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1724 microversion: 2.20 time: 0.224345 Jan 10 11:42:54.783535 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 414/829] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:42:54 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:42:55.654926 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-0a7d0598-2943-4a53-9275-7eb7873213aa tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:55.655975 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-0a7d0598-2943-4a53-9275-7eb7873213aa tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:55.662954 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0a7d0598-2943-4a53-9275-7eb7873213aa tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:55.663398 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0a7d0598-2943-4a53-9275-7eb7873213aa tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:55.664185 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0a7d0598-2943-4a53-9275-7eb7873213aa tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:55.664772 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0a7d0598-2943-4a53-9275-7eb7873213aa tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:55.735542 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-0a7d0598-2943-4a53-9275-7eb7873213aa tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 25751 microversion: 2.1 time: 0.085397 Jan 10 11:42:55.739034 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 416/830] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:55 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 25751 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:42:55.802149 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-161baa36-1460-483e-8be4-5a7d46bc569c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:55.807839 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-161baa36-1460-483e-8be4-5a7d46bc569c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:55.810480 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-161baa36-1460-483e-8be4-5a7d46bc569c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:55.810937 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-161baa36-1460-483e-8be4-5a7d46bc569c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:55.811758 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-161baa36-1460-483e-8be4-5a7d46bc569c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:55.812211 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-161baa36-1460-483e-8be4-5a7d46bc569c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:55.978799 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-161baa36-1460-483e-8be4-5a7d46bc569c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:55.987505 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-161baa36-1460-483e-8be4-5a7d46bc569c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:55.989264 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-161baa36-1460-483e-8be4-5a7d46bc569c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:55.990628 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-161baa36-1460-483e-8be4-5a7d46bc569c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1724 microversion: 2.20 time: 0.192280 Jan 10 11:42:56.002766 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 415/831] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:42:55 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:42:56.748936 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3b7a46d4-7b7c-4221-adf6-72881747d9ce tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:56.749946 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-3b7a46d4-7b7c-4221-adf6-72881747d9ce tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:56.757112 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3b7a46d4-7b7c-4221-adf6-72881747d9ce tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:56.757563 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3b7a46d4-7b7c-4221-adf6-72881747d9ce tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:56.758485 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3b7a46d4-7b7c-4221-adf6-72881747d9ce tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:56.758948 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3b7a46d4-7b7c-4221-adf6-72881747d9ce tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:56.832996 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3b7a46d4-7b7c-4221-adf6-72881747d9ce tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 27062 microversion: 2.1 time: 0.088756 Jan 10 11:42:56.838521 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 417/832] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:56 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 27062 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:42:57.011399 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-fbd27135-e265-41ff-9ded-1ef4aa48ab3e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:57.014087 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-fbd27135-e265-41ff-9ded-1ef4aa48ab3e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:57.025840 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fbd27135-e265-41ff-9ded-1ef4aa48ab3e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:57.026572 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fbd27135-e265-41ff-9ded-1ef4aa48ab3e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:57.036696 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fbd27135-e265-41ff-9ded-1ef4aa48ab3e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:57.036696 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fbd27135-e265-41ff-9ded-1ef4aa48ab3e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:57.178176 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-fbd27135-e265-41ff-9ded-1ef4aa48ab3e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:57.202376 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-fbd27135-e265-41ff-9ded-1ef4aa48ab3e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:57.206366 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-fbd27135-e265-41ff-9ded-1ef4aa48ab3e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:57.211614 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-fbd27135-e265-41ff-9ded-1ef4aa48ab3e tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1724 microversion: 2.20 time: 0.203296 Jan 10 11:42:57.211614 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 416/833] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:42:57 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:42:57.845064 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-928fa956-a940-48e9-aa11-da1119f4009f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:57.846074 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-928fa956-a940-48e9-aa11-da1119f4009f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:57.862844 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-928fa956-a940-48e9-aa11-da1119f4009f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:57.863300 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-928fa956-a940-48e9-aa11-da1119f4009f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:57.864116 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-928fa956-a940-48e9-aa11-da1119f4009f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:57.864628 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-928fa956-a940-48e9-aa11-da1119f4009f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:57.968259 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-928fa956-a940-48e9-aa11-da1119f4009f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 27815 microversion: 2.1 time: 0.126691 Jan 10 11:42:57.969034 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 418/834] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:57 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 27815 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:42:58.230148 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f0e576f3-4cb3-41a0-a7e7-f146f688eac2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:58.232010 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f0e576f3-4cb3-41a0-a7e7-f146f688eac2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:58.239273 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f0e576f3-4cb3-41a0-a7e7-f146f688eac2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:58.239815 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f0e576f3-4cb3-41a0-a7e7-f146f688eac2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:58.240727 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f0e576f3-4cb3-41a0-a7e7-f146f688eac2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:58.241673 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f0e576f3-4cb3-41a0-a7e7-f146f688eac2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:58.486172 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f0e576f3-4cb3-41a0-a7e7-f146f688eac2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:58.495463 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f0e576f3-4cb3-41a0-a7e7-f146f688eac2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:58.497722 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f0e576f3-4cb3-41a0-a7e7-f146f688eac2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:42:58.499180 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f0e576f3-4cb3-41a0-a7e7-f146f688eac2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1745 microversion: 2.20 time: 0.274765 Jan 10 11:42:58.500312 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 417/835] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:42:58 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1745 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:42:58.980268 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ef0540c2-5302-4714-9670-4f151a701b8b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:42:58.981765 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ef0540c2-5302-4714-9670-4f151a701b8b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:58.988996 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ef0540c2-5302-4714-9670-4f151a701b8b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:58.989462 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ef0540c2-5302-4714-9670-4f151a701b8b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:58.990371 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ef0540c2-5302-4714-9670-4f151a701b8b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:58.990807 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ef0540c2-5302-4714-9670-4f151a701b8b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:59.076229 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ef0540c2-5302-4714-9670-4f151a701b8b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 28165 microversion: 2.1 time: 0.099878 Jan 10 11:42:59.077691 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 419/836] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:42:58 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 28165 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:42:59.517703 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0e2e366c-b607-4771-9786-84d141bbc401 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:42:59.518658 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0e2e366c-b607-4771-9786-84d141bbc401 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:42:59.525955 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e2e366c-b607-4771-9786-84d141bbc401 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:59.526709 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e2e366c-b607-4771-9786-84d141bbc401 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:42:59.528416 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e2e366c-b607-4771-9786-84d141bbc401 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:42:59.529143 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e2e366c-b607-4771-9786-84d141bbc401 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:00.053444 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0e2e366c-b607-4771-9786-84d141bbc401 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:00.062893 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0e2e366c-b607-4771-9786-84d141bbc401 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:00.064933 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0e2e366c-b607-4771-9786-84d141bbc401 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:00.066568 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0e2e366c-b607-4771-9786-84d141bbc401 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1745 microversion: 2.20 time: 0.552623 Jan 10 11:43:00.067614 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 418/837] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:42:59 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1745 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:00.089066 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-fd8777a3-8a05-41a5-8cbc-5d6b8d5927f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:00.090752 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-fd8777a3-8a05-41a5-8cbc-5d6b8d5927f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:00.097907 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fd8777a3-8a05-41a5-8cbc-5d6b8d5927f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:00.104861 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fd8777a3-8a05-41a5-8cbc-5d6b8d5927f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:00.104861 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fd8777a3-8a05-41a5-8cbc-5d6b8d5927f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:00.104861 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fd8777a3-8a05-41a5-8cbc-5d6b8d5927f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:00.166872 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-fd8777a3-8a05-41a5-8cbc-5d6b8d5927f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 28165 microversion: 2.1 time: 0.081880 Jan 10 11:43:00.173441 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 420/838] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:43:00 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 28165 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:43:01.092305 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-989fc223-0923-4f22-bcea-da9cb25cff15 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:01.094573 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-989fc223-0923-4f22-bcea-da9cb25cff15 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:01.107031 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-989fc223-0923-4f22-bcea-da9cb25cff15 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:01.108264 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-989fc223-0923-4f22-bcea-da9cb25cff15 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:01.109333 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-989fc223-0923-4f22-bcea-da9cb25cff15 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:01.110070 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-989fc223-0923-4f22-bcea-da9cb25cff15 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:01.190900 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-4d2f6e7a-d6a7-400e-bf0c-522b3aaa50db tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:01.194537 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-4d2f6e7a-d6a7-400e-bf0c-522b3aaa50db tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:01.215851 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4d2f6e7a-d6a7-400e-bf0c-522b3aaa50db tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:01.216697 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4d2f6e7a-d6a7-400e-bf0c-522b3aaa50db tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:01.221189 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4d2f6e7a-d6a7-400e-bf0c-522b3aaa50db tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:01.224320 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4d2f6e7a-d6a7-400e-bf0c-522b3aaa50db tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:01.325057 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-4d2f6e7a-d6a7-400e-bf0c-522b3aaa50db tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 28165 microversion: 2.1 time: 0.148860 Jan 10 11:43:01.333146 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 421/839] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:43:01 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 28165 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:43:01.406152 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-989fc223-0923-4f22-bcea-da9cb25cff15 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:01.416883 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-989fc223-0923-4f22-bcea-da9cb25cff15 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:01.419780 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-989fc223-0923-4f22-bcea-da9cb25cff15 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:01.425721 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-989fc223-0923-4f22-bcea-da9cb25cff15 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1740 microversion: 2.20 time: 0.336437 Jan 10 11:43:01.425721 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 419/840] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:01 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1740 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:02.350260 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-88064645-a8ce-4965-a2ee-731da5669654 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:02.354413 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-88064645-a8ce-4965-a2ee-731da5669654 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:02.373563 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-88064645-a8ce-4965-a2ee-731da5669654 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:02.374033 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-88064645-a8ce-4965-a2ee-731da5669654 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:02.374906 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-88064645-a8ce-4965-a2ee-731da5669654 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:02.375346 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-88064645-a8ce-4965-a2ee-731da5669654 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:02.444903 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0f91937e-2fb6-4674-acfd-f9955b221dd1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:02.445990 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0f91937e-2fb6-4674-acfd-f9955b221dd1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:02.471066 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0f91937e-2fb6-4674-acfd-f9955b221dd1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:02.471521 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0f91937e-2fb6-4674-acfd-f9955b221dd1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:02.472313 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0f91937e-2fb6-4674-acfd-f9955b221dd1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:02.478997 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0f91937e-2fb6-4674-acfd-f9955b221dd1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:02.522888 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-88064645-a8ce-4965-a2ee-731da5669654 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 28456 microversion: 2.1 time: 0.184122 Jan 10 11:43:02.523833 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 422/841] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:43:02 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 28456 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:43:02.551394 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-df05ed75-f928-46f2-aa9d-8a4b3b8cd56b req-6f2b37fd-e331-474b-9671-c5b292b6a8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70029374-0ab3-49b9-880e-6a102761c463", "name": "network-vif-plugged", "status": "completed", "tag": "5d53e751-c135-4aa3-b56f-602088936cc0"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:02.559265 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:43:02.559265 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:43:02.584307 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-df05ed75-f928-46f2-aa9d-8a4b3b8cd56b req-6f2b37fd-e331-474b-9671-c5b292b6a8b1 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:02.590417 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-df05ed75-f928-46f2-aa9d-8a4b3b8cd56b req-6f2b37fd-e331-474b-9671-c5b292b6a8b1 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:02.626578 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-df05ed75-f928-46f2-aa9d-8a4b3b8cd56b req-6f2b37fd-e331-474b-9671-c5b292b6a8b1 service nova] Creating event network-vif-plugged:5d53e751-c135-4aa3-b56f-602088936cc0 for instance 70029374-0ab3-49b9-880e-6a102761c463 on hv-cinder-maste Jan 10 11:43:02.636759 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-df05ed75-f928-46f2-aa9d-8a4b3b8cd56b req-6f2b37fd-e331-474b-9671-c5b292b6a8b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109545 Jan 10 11:43:02.641907 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 423/842] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:43:02.815613 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0f91937e-2fb6-4674-acfd-f9955b221dd1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:02.831015 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0f91937e-2fb6-4674-acfd-f9955b221dd1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:02.832676 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0f91937e-2fb6-4674-acfd-f9955b221dd1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:02.833865 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0f91937e-2fb6-4674-acfd-f9955b221dd1 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1740 microversion: 2.20 time: 0.396646 Jan 10 11:43:02.840364 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 420/843] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:02 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1740 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:03.535572 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-89c67c59-bb2e-457d-aa83-82a70b4f6c6f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:03.536580 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-89c67c59-bb2e-457d-aa83-82a70b4f6c6f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:03.550915 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-89c67c59-bb2e-457d-aa83-82a70b4f6c6f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:03.553911 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-89c67c59-bb2e-457d-aa83-82a70b4f6c6f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:03.554804 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-89c67c59-bb2e-457d-aa83-82a70b4f6c6f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:03.555423 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-89c67c59-bb2e-457d-aa83-82a70b4f6c6f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:03.670079 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-89c67c59-bb2e-457d-aa83-82a70b4f6c6f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 28624 microversion: 2.1 time: 0.137919 Jan 10 11:43:03.674391 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 424/844] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:43:03 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 28624 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:43:03.859831 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-9bad8b1e-e619-40f1-be3b-079045fd8346 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:03.860625 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-9bad8b1e-e619-40f1-be3b-079045fd8346 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:03.875033 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9bad8b1e-e619-40f1-be3b-079045fd8346 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:03.875500 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9bad8b1e-e619-40f1-be3b-079045fd8346 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:03.876327 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9bad8b1e-e619-40f1-be3b-079045fd8346 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:03.876769 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-9bad8b1e-e619-40f1-be3b-079045fd8346 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:04.250843 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-9bad8b1e-e619-40f1-be3b-079045fd8346 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:04.263386 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-9bad8b1e-e619-40f1-be3b-079045fd8346 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:04.265025 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-9bad8b1e-e619-40f1-be3b-079045fd8346 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:04.266397 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-9bad8b1e-e619-40f1-be3b-079045fd8346 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1740 microversion: 2.20 time: 0.411531 Jan 10 11:43:04.275802 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 421/845] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:03 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1740 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:04.682363 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5166b55b-4366-4052-8c93-8064f69e8f48 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:04.685571 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5166b55b-4366-4052-8c93-8064f69e8f48 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:04.694176 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5166b55b-4366-4052-8c93-8064f69e8f48 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:04.694860 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5166b55b-4366-4052-8c93-8064f69e8f48 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:04.696164 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5166b55b-4366-4052-8c93-8064f69e8f48 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:04.696786 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5166b55b-4366-4052-8c93-8064f69e8f48 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:04.906739 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5166b55b-4366-4052-8c93-8064f69e8f48 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 28624 microversion: 2.1 time: 0.093484 Jan 10 11:43:04.906739 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 425/846] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:43:04 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 28624 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:43:05.284769 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-512aecba-4ed1-4f74-a58d-ed5c563ae6e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:05.285373 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-512aecba-4ed1-4f74-a58d-ed5c563ae6e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:05.294146 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-512aecba-4ed1-4f74-a58d-ed5c563ae6e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:05.297349 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-512aecba-4ed1-4f74-a58d-ed5c563ae6e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:05.297934 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-512aecba-4ed1-4f74-a58d-ed5c563ae6e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:05.299055 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-512aecba-4ed1-4f74-a58d-ed5c563ae6e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:05.550380 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-512aecba-4ed1-4f74-a58d-ed5c563ae6e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:05.564133 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-512aecba-4ed1-4f74-a58d-ed5c563ae6e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:05.565689 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-512aecba-4ed1-4f74-a58d-ed5c563ae6e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:05.577651 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-512aecba-4ed1-4f74-a58d-ed5c563ae6e0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1740 microversion: 2.20 time: 0.285830 Jan 10 11:43:05.588958 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 422/847] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:05 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:05.785018 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-0165c0af-f5ab-44bb-9fad-1491c7ef148c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:05.799103 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-0165c0af-f5ab-44bb-9fad-1491c7ef148c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:05.822733 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0165c0af-f5ab-44bb-9fad-1491c7ef148c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:05.824042 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0165c0af-f5ab-44bb-9fad-1491c7ef148c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:05.825943 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0165c0af-f5ab-44bb-9fad-1491c7ef148c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:05.856990 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0165c0af-f5ab-44bb-9fad-1491c7ef148c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:06.085400 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-0165c0af-f5ab-44bb-9fad-1491c7ef148c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 28624 microversion: 2.1 time: 0.302828 Jan 10 11:43:06.087894 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 426/848] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:43:05 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 28624 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:43:06.597261 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-21e64918-4f15-4b4a-b838-d72f0c27adc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:06.598550 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-21e64918-4f15-4b4a-b838-d72f0c27adc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:06.618675 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-21e64918-4f15-4b4a-b838-d72f0c27adc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:06.619446 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-21e64918-4f15-4b4a-b838-d72f0c27adc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:06.620453 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-21e64918-4f15-4b4a-b838-d72f0c27adc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:06.621062 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-21e64918-4f15-4b4a-b838-d72f0c27adc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:06.848098 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-21e64918-4f15-4b4a-b838-d72f0c27adc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:06.859097 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-21e64918-4f15-4b4a-b838-d72f0c27adc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:06.863084 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-21e64918-4f15-4b4a-b838-d72f0c27adc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:06.865763 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-21e64918-4f15-4b4a-b838-d72f0c27adc2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1740 microversion: 2.20 time: 0.272586 Jan 10 11:43:06.868263 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 423/849] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:06 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1740 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:07.099462 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-df37df3e-6053-4a30-8653-bed5f345f942 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:07.100360 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-df37df3e-6053-4a30-8653-bed5f345f942 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:07.112893 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-df37df3e-6053-4a30-8653-bed5f345f942 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:07.114151 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-df37df3e-6053-4a30-8653-bed5f345f942 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:07.115237 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-df37df3e-6053-4a30-8653-bed5f345f942 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:07.128995 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-df37df3e-6053-4a30-8653-bed5f345f942 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:07.285381 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-df37df3e-6053-4a30-8653-bed5f345f942 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 29337 microversion: 2.1 time: 0.190214 Jan 10 11:43:07.292567 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 427/850] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:43:07 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 29337 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:43:07.889780 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0d08125d-4698-4289-a26e-5393261d2b79 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:07.891441 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0d08125d-4698-4289-a26e-5393261d2b79 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:07.901490 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0d08125d-4698-4289-a26e-5393261d2b79 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:07.919285 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0d08125d-4698-4289-a26e-5393261d2b79 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:07.926820 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0d08125d-4698-4289-a26e-5393261d2b79 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:07.927645 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0d08125d-4698-4289-a26e-5393261d2b79 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:08.301593 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-6bb331b5-40a7-43bb-8495-a55c1926d15f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:08.302779 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-6bb331b5-40a7-43bb-8495-a55c1926d15f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:08.321589 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6bb331b5-40a7-43bb-8495-a55c1926d15f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:08.329047 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6bb331b5-40a7-43bb-8495-a55c1926d15f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:08.332454 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0d08125d-4698-4289-a26e-5393261d2b79 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:08.332752 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6bb331b5-40a7-43bb-8495-a55c1926d15f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:08.333274 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6bb331b5-40a7-43bb-8495-a55c1926d15f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:08.346634 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0d08125d-4698-4289-a26e-5393261d2b79 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:08.350882 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0d08125d-4698-4289-a26e-5393261d2b79 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:08.355169 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0d08125d-4698-4289-a26e-5393261d2b79 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1740 microversion: 2.20 time: 0.470263 Jan 10 11:43:08.357084 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 424/851] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:07 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1740 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:08.494906 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-6bb331b5-40a7-43bb-8495-a55c1926d15f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 31605 microversion: 2.1 time: 0.197397 Jan 10 11:43:08.500387 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 428/852] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:43:08 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 31605 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:43:09.376097 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b3f84e87-8d00-485d-a9f9-9e991084e49b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:09.376617 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b3f84e87-8d00-485d-a9f9-9e991084e49b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:09.385335 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b3f84e87-8d00-485d-a9f9-9e991084e49b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:09.386083 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b3f84e87-8d00-485d-a9f9-9e991084e49b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:09.387935 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b3f84e87-8d00-485d-a9f9-9e991084e49b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:09.388569 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b3f84e87-8d00-485d-a9f9-9e991084e49b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:09.508293 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-c340c27d-5a55-459a-bdb6-40e9f8606fbc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:09.511144 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-c340c27d-5a55-459a-bdb6-40e9f8606fbc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:09.535328 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c340c27d-5a55-459a-bdb6-40e9f8606fbc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:09.547137 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b3f84e87-8d00-485d-a9f9-9e991084e49b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:09.547554 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c340c27d-5a55-459a-bdb6-40e9f8606fbc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:09.551764 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c340c27d-5a55-459a-bdb6-40e9f8606fbc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:09.552346 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c340c27d-5a55-459a-bdb6-40e9f8606fbc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:09.555331 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b3f84e87-8d00-485d-a9f9-9e991084e49b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:09.558410 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b3f84e87-8d00-485d-a9f9-9e991084e49b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:09.560567 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b3f84e87-8d00-485d-a9f9-9e991084e49b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1740 microversion: 2.20 time: 0.189374 Jan 10 11:43:09.561317 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 425/853] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:09 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:09.652820 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-c340c27d-5a55-459a-bdb6-40e9f8606fbc tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 32914 microversion: 2.1 time: 0.147923 Jan 10 11:43:09.654327 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 429/854] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:43:09 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 32914 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:43:10.580986 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ed571898-1dc6-4565-848e-686396a61421 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:10.581720 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ed571898-1dc6-4565-848e-686396a61421 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:10.592386 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ed571898-1dc6-4565-848e-686396a61421 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:10.592853 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ed571898-1dc6-4565-848e-686396a61421 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:10.593809 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ed571898-1dc6-4565-848e-686396a61421 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:10.594162 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ed571898-1dc6-4565-848e-686396a61421 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:10.668465 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b816cdc2-644a-4b92-a7a3-94301166626f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:10.669690 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b816cdc2-644a-4b92-a7a3-94301166626f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:10.683564 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b816cdc2-644a-4b92-a7a3-94301166626f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:10.685156 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b816cdc2-644a-4b92-a7a3-94301166626f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:10.686316 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b816cdc2-644a-4b92-a7a3-94301166626f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:10.687412 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b816cdc2-644a-4b92-a7a3-94301166626f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:10.779487 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b816cdc2-644a-4b92-a7a3-94301166626f tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 33816 microversion: 2.1 time: 0.114453 Jan 10 11:43:10.780913 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 430/855] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:43:10 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 33816 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 10 11:43:10.782043 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ed571898-1dc6-4565-848e-686396a61421 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:10.791543 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ed571898-1dc6-4565-848e-686396a61421 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:10.793465 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ed571898-1dc6-4565-848e-686396a61421 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:10.794679 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ed571898-1dc6-4565-848e-686396a61421 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1740 microversion: 2.20 time: 0.218591 Jan 10 11:43:10.795757 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 426/856] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:10 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:11.794453 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-bb189597-ce3c-418b-9817-a62b20e03453 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:11.796549 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-bb189597-ce3c-418b-9817-a62b20e03453 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:11.816119 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ced853a9-074c-43b6-895d-18f9ce617f13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:11.817444 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ced853a9-074c-43b6-895d-18f9ce617f13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:11.828619 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ced853a9-074c-43b6-895d-18f9ce617f13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:11.830835 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bb189597-ce3c-418b-9817-a62b20e03453 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:11.831661 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ced853a9-074c-43b6-895d-18f9ce617f13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:11.832722 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ced853a9-074c-43b6-895d-18f9ce617f13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:11.833375 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ced853a9-074c-43b6-895d-18f9ce617f13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:11.834142 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bb189597-ce3c-418b-9817-a62b20e03453 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:11.839680 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bb189597-ce3c-418b-9817-a62b20e03453 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:11.847118 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bb189597-ce3c-418b-9817-a62b20e03453 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:11.950186 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-bb189597-ce3c-418b-9817-a62b20e03453 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 35294 microversion: 2.1 time: 0.160512 Jan 10 11:43:11.952182 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 431/857] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:43:11 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 35294 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:43:12.099816 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ced853a9-074c-43b6-895d-18f9ce617f13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:12.115341 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ced853a9-074c-43b6-895d-18f9ce617f13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:12.122988 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ced853a9-074c-43b6-895d-18f9ce617f13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:12.132839 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ced853a9-074c-43b6-895d-18f9ce617f13 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1740 microversion: 2.20 time: 0.321111 Jan 10 11:43:12.133622 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 427/858] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:11 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1740 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:12.968689 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-c5989126-49bf-4c76-ab1f-68027a04f4e8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:12.970615 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-c5989126-49bf-4c76-ab1f-68027a04f4e8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:12.977541 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c5989126-49bf-4c76-ab1f-68027a04f4e8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:12.978388 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c5989126-49bf-4c76-ab1f-68027a04f4e8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:12.979441 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c5989126-49bf-4c76-ab1f-68027a04f4e8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:12.980225 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c5989126-49bf-4c76-ab1f-68027a04f4e8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:13.097804 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-c5989126-49bf-4c76-ab1f-68027a04f4e8 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 36826 microversion: 2.1 time: 0.133637 Jan 10 11:43:13.099072 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 432/859] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:43:12 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 36826 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:43:13.161146 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c2ea1ec6-ac8b-41ab-b4af-3852da773b92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:13.162502 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c2ea1ec6-ac8b-41ab-b4af-3852da773b92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:13.169720 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c2ea1ec6-ac8b-41ab-b4af-3852da773b92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:13.170265 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c2ea1ec6-ac8b-41ab-b4af-3852da773b92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:13.171259 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c2ea1ec6-ac8b-41ab-b4af-3852da773b92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:13.171697 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c2ea1ec6-ac8b-41ab-b4af-3852da773b92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:13.328949 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c2ea1ec6-ac8b-41ab-b4af-3852da773b92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:13.339512 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c2ea1ec6-ac8b-41ab-b4af-3852da773b92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:13.341906 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c2ea1ec6-ac8b-41ab-b4af-3852da773b92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:13.344204 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c2ea1ec6-ac8b-41ab-b4af-3852da773b92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1740 microversion: 2.20 time: 0.187078 Jan 10 11:43:13.345041 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 428/860] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:13 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:43:14.111813 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-92b5b731-27cc-4bed-b0cc-fd35004ba25e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:14.112851 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-92b5b731-27cc-4bed-b0cc-fd35004ba25e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:14.125521 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-92b5b731-27cc-4bed-b0cc-fd35004ba25e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:14.125979 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-92b5b731-27cc-4bed-b0cc-fd35004ba25e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:14.126817 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-92b5b731-27cc-4bed-b0cc-fd35004ba25e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:14.127346 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-92b5b731-27cc-4bed-b0cc-fd35004ba25e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:14.240164 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-92b5b731-27cc-4bed-b0cc-fd35004ba25e tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 38158 microversion: 2.1 time: 0.132570 Jan 10 11:43:14.242139 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 433/861] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:43:14 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 38158 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:43:14.363026 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-98d2a7ef-9979-4001-b575-9e79b6021349 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:14.363604 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-98d2a7ef-9979-4001-b575-9e79b6021349 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:14.370063 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-98d2a7ef-9979-4001-b575-9e79b6021349 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:14.370545 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-98d2a7ef-9979-4001-b575-9e79b6021349 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:14.371347 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-98d2a7ef-9979-4001-b575-9e79b6021349 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:14.371808 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-98d2a7ef-9979-4001-b575-9e79b6021349 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:14.523985 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-98d2a7ef-9979-4001-b575-9e79b6021349 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:14.531965 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-98d2a7ef-9979-4001-b575-9e79b6021349 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:14.533468 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-98d2a7ef-9979-4001-b575-9e79b6021349 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:14.534645 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-98d2a7ef-9979-4001-b575-9e79b6021349 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1740 microversion: 2.20 time: 0.175422 Jan 10 11:43:14.535215 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 429/862] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:14 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:15.253442 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a39a79ed-8f56-4240-aa69-6761a526e5b5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:15.254481 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a39a79ed-8f56-4240-aa69-6761a526e5b5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:15.261775 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a39a79ed-8f56-4240-aa69-6761a526e5b5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:15.262500 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a39a79ed-8f56-4240-aa69-6761a526e5b5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:15.263445 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a39a79ed-8f56-4240-aa69-6761a526e5b5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:15.263880 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a39a79ed-8f56-4240-aa69-6761a526e5b5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:15.328552 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a39a79ed-8f56-4240-aa69-6761a526e5b5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 38158 microversion: 2.1 time: 0.079204 Jan 10 11:43:15.329343 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 434/863] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:43:15 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 38158 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:43:15.553152 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-928d4c60-0505-401e-9915-5ceec336192c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:15.554535 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-928d4c60-0505-401e-9915-5ceec336192c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:15.563168 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-928d4c60-0505-401e-9915-5ceec336192c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:15.563954 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-928d4c60-0505-401e-9915-5ceec336192c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:15.564899 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-928d4c60-0505-401e-9915-5ceec336192c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:15.565523 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-928d4c60-0505-401e-9915-5ceec336192c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:15.712078 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-928d4c60-0505-401e-9915-5ceec336192c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:15.720674 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-928d4c60-0505-401e-9915-5ceec336192c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:15.722294 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-928d4c60-0505-401e-9915-5ceec336192c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:15.723667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-928d4c60-0505-401e-9915-5ceec336192c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1740 microversion: 2.20 time: 0.174308 Jan 10 11:43:15.734909 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 430/864] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:15 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:16.342327 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5f7efac3-de39-4549-933b-29d7b4b4ceca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:16.343304 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5f7efac3-de39-4549-933b-29d7b4b4ceca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:16.350252 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5f7efac3-de39-4549-933b-29d7b4b4ceca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:16.350935 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5f7efac3-de39-4549-933b-29d7b4b4ceca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:16.351725 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5f7efac3-de39-4549-933b-29d7b4b4ceca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:16.352162 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5f7efac3-de39-4549-933b-29d7b4b4ceca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:16.407266 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e007baa0-e356-4931-87ab-0737cdf0c748 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Action: 'create', calling method: .version_select at 0x7f477996adc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1815420863"}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:16.413114 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5f7efac3-de39-4549-933b-29d7b4b4ceca tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 38158 microversion: 2.1 time: 0.075851 Jan 10 11:43:16.416465 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 435/865] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:43:16 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 38158 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:43:16.424760 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-e007baa0-e356-4931-87ab-0737cdf0c748 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Getting quotas for project e45c180d632e41cdb97880086d7705c2. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:43:16.429096 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-e007baa0-e356-4931-87ab-0737cdf0c748 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Getting quotas for user 54f31a023173496e977e99bbc0eb6b8b and project e45c180d632e41cdb97880086d7705c2. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:43:16.609809 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-e007baa0-e356-4931-87ab-0737cdf0c748 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Getting quotas for project e45c180d632e41cdb97880086d7705c2. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:43:16.613703 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-e007baa0-e356-4931-87ab-0737cdf0c748 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Getting quotas for user 54f31a023173496e977e99bbc0eb6b8b and project e45c180d632e41cdb97880086d7705c2. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:43:16.628178 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e007baa0-e356-4931-87ab-0737cdf0c748 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.225600 Jan 10 11:43:16.628785 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 431/866] 10.222.0.20 () {60 vars in 1157 bytes} [Mon Jan 10 11:43:16 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:16.684930 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e971250f-2703-45ae-99cd-c19bb9678c2e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-768144741", "imageRef": "a901444f-804a-4867-b822-e9cf858f140d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1815420863", "networks": [{"uuid": "00bdfc4a-b204-4e19-8d0f-3802efe9f3c9"}]}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:16.734784 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.network.neutron [None req-e971250f-2703-45ae-99cd-c19bb9678c2e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] validate_networks() for [('00bdfc4a-b204-4e19-8d0f-3802efe9f3c9', None, None, None, None, None)] {{(pid=128719) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:43:16.741125 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-25f181b9-5db5-4600-8810-55d2f02a86f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:16.742001 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-25f181b9-5db5-4600-8810-55d2f02a86f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:16.748742 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-25f181b9-5db5-4600-8810-55d2f02a86f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:16.749262 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-25f181b9-5db5-4600-8810-55d2f02a86f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:16.750001 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-25f181b9-5db5-4600-8810-55d2f02a86f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:16.750481 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-25f181b9-5db5-4600-8810-55d2f02a86f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:16.975095 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-25f181b9-5db5-4600-8810-55d2f02a86f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:16.984149 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-25f181b9-5db5-4600-8810-55d2f02a86f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:16.985665 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-25f181b9-5db5-4600-8810-55d2f02a86f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:16.986878 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-25f181b9-5db5-4600-8810-55d2f02a86f2 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1722 microversion: 2.20 time: 0.249544 Jan 10 11:43:16.987442 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 432/867] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:16 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:17.228937 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-e971250f-2703-45ae-99cd-c19bb9678c2e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Flavor limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:43:17.229531 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-e971250f-2703-45ae-99cd-c19bb9678c2e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Image limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:43:17.229952 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-e971250f-2703-45ae-99cd-c19bb9678c2e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Flavor pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:43:17.230396 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-e971250f-2703-45ae-99cd-c19bb9678c2e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Image pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:43:17.236288 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-e971250f-2703-45ae-99cd-c19bb9678c2e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:43:17.239458 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e971250f-2703-45ae-99cd-c19bb9678c2e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:17.239907 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e971250f-2703-45ae-99cd-c19bb9678c2e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:17.240710 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e971250f-2703-45ae-99cd-c19bb9678c2e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:17.241139 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e971250f-2703-45ae-99cd-c19bb9678c2e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:17.257770 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-e971250f-2703-45ae-99cd-c19bb9678c2e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Getting quotas for project e45c180d632e41cdb97880086d7705c2. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:43:17.262589 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-e971250f-2703-45ae-99cd-c19bb9678c2e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Getting quotas for user 54f31a023173496e977e99bbc0eb6b8b and project e45c180d632e41cdb97880086d7705c2. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:43:17.274019 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-e971250f-2703-45ae-99cd-c19bb9678c2e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Going to run 1 instances... {{(pid=128719) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:43:17.276403 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-e971250f-2703-45ae-99cd-c19bb9678c2e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a901444f-804a-4867-b822-e9cf858f140d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:43:17.417959 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-e971250f-2703-45ae-99cd-c19bb9678c2e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737050 Jan 10 11:43:17.418897 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 436/868] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:43:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 11:43:17.426915 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f565eff4-6e21-4a80-b38a-25030645d2e1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:17.428473 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-046be68d-89bb-4635-8acf-40468dcb1fce tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:17.429094 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-046be68d-89bb-4635-8acf-40468dcb1fce tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:17.429414 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f565eff4-6e21-4a80-b38a-25030645d2e1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:17.438546 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f565eff4-6e21-4a80-b38a-25030645d2e1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:17.439001 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f565eff4-6e21-4a80-b38a-25030645d2e1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:17.440188 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f565eff4-6e21-4a80-b38a-25030645d2e1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:17.440479 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f565eff4-6e21-4a80-b38a-25030645d2e1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:17.490609 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-046be68d-89bb-4635-8acf-40468dcb1fce tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:17.498815 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-046be68d-89bb-4635-8acf-40468dcb1fce tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1258 microversion: 2.1 time: 0.073822 Jan 10 11:43:17.499398 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 437/869] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:17 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:43:17.513648 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f565eff4-6e21-4a80-b38a-25030645d2e1 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 38158 microversion: 2.1 time: 0.089739 Jan 10 11:43:17.514341 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 433/870] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:43:17 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 38158 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:43:18.007831 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-36fe52ec-5f66-4abb-8d88-3add2073cd3d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:18.008444 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-36fe52ec-5f66-4abb-8d88-3add2073cd3d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:18.015783 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-36fe52ec-5f66-4abb-8d88-3add2073cd3d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:18.016235 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-36fe52ec-5f66-4abb-8d88-3add2073cd3d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:18.017066 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-36fe52ec-5f66-4abb-8d88-3add2073cd3d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:18.017508 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-36fe52ec-5f66-4abb-8d88-3add2073cd3d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:18.147183 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-36fe52ec-5f66-4abb-8d88-3add2073cd3d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:18.155530 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-36fe52ec-5f66-4abb-8d88-3add2073cd3d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:18.157113 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-36fe52ec-5f66-4abb-8d88-3add2073cd3d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:18.158291 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-36fe52ec-5f66-4abb-8d88-3add2073cd3d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1722 microversion: 2.20 time: 0.154168 Jan 10 11:43:18.158841 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 438/871] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:18 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:18.517256 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-81420237-4770-40f9-a2bf-110b650891a2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:18.637830 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-81420237-4770-40f9-a2bf-110b650891a2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:18.637928 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-02fa598c-c087-4d25-8e3d-546e5b2a6908 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:18.637928 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-02fa598c-c087-4d25-8e3d-546e5b2a6908 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:18.637928 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-02fa598c-c087-4d25-8e3d-546e5b2a6908 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:18.637928 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-02fa598c-c087-4d25-8e3d-546e5b2a6908 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:18.638548 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-02fa598c-c087-4d25-8e3d-546e5b2a6908 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:18.638548 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-02fa598c-c087-4d25-8e3d-546e5b2a6908 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:18.638822 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-81420237-4770-40f9-a2bf-110b650891a2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:18.638822 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-81420237-4770-40f9-a2bf-110b650891a2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1258 microversion: 2.1 time: 0.070799 Jan 10 11:43:18.638822 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 434/872] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:18 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:18.639072 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-02fa598c-c087-4d25-8e3d-546e5b2a6908 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action" status: 200 len: 38289 microversion: 2.1 time: 0.089489 Jan 10 11:43:18.639072 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 439/873] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:43:18 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/action => generated 38289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:43:18.639223 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-6b6e68d0-baea-42dc-bf8c-528039c351f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:18.639223 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-6b6e68d0-baea-42dc-bf8c-528039c351f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:18.639223 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6b6e68d0-baea-42dc-bf8c-528039c351f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:18.639223 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6b6e68d0-baea-42dc-bf8c-528039c351f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:18.639550 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6b6e68d0-baea-42dc-bf8c-528039c351f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:18.639550 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6b6e68d0-baea-42dc-bf8c-528039c351f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:18.655337 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-6b6e68d0-baea-42dc-bf8c-528039c351f7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/ips" status: 200 len: 145 microversion: 2.1 time: 0.036163 Jan 10 11:43:18.655913 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 435/874] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jan 10 11:43:18 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:43:19.176939 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-01dab572-bf93-4652-b4c5-68b2e6e08a06 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:19.178481 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-01dab572-bf93-4652-b4c5-68b2e6e08a06 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:19.184682 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-01dab572-bf93-4652-b4c5-68b2e6e08a06 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:19.185197 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-01dab572-bf93-4652-b4c5-68b2e6e08a06 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:19.185988 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-01dab572-bf93-4652-b4c5-68b2e6e08a06 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:19.186453 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-01dab572-bf93-4652-b4c5-68b2e6e08a06 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:19.324346 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-01dab572-bf93-4652-b4c5-68b2e6e08a06 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:19.332895 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-01dab572-bf93-4652-b4c5-68b2e6e08a06 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:19.334463 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-01dab572-bf93-4652-b4c5-68b2e6e08a06 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:19.335609 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-01dab572-bf93-4652-b4c5-68b2e6e08a06 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1725 microversion: 2.20 time: 0.162785 Jan 10 11:43:19.336167 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 440/875] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:19 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:19.353713 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-84ebe59a-c64a-4290-bc7c-e230af8e8d73 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad370c29-6a85-4b21-bf4d-5c2518c0c832"}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:19.354977 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-84ebe59a-c64a-4290-bc7c-e230af8e8d73 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:19.361391 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-84ebe59a-c64a-4290-bc7c-e230af8e8d73 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:19.361847 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-84ebe59a-c64a-4290-bc7c-e230af8e8d73 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:19.362653 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-84ebe59a-c64a-4290-bc7c-e230af8e8d73 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:19.363097 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-84ebe59a-c64a-4290-bc7c-e230af8e8d73 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:19.615712 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e97319fa-ae89-4d62-ba5f-4aef1ee7796a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:19.615712 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-e97319fa-ae89-4d62-ba5f-4aef1ee7796a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:19.615712 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e97319fa-ae89-4d62-ba5f-4aef1ee7796a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:19.615712 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e97319fa-ae89-4d62-ba5f-4aef1ee7796a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:19.616561 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e97319fa-ae89-4d62-ba5f-4aef1ee7796a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:19.616561 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e97319fa-ae89-4d62-ba5f-4aef1ee7796a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:19.670590 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-e97319fa-ae89-4d62-ba5f-4aef1ee7796a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:19.678070 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-e97319fa-ae89-4d62-ba5f-4aef1ee7796a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1254 microversion: 2.1 time: 0.081288 Jan 10 11:43:19.678680 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 441/876] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:19 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1254 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:43:20.255611 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-2b929227-0351-4a65-a3b2-c023b7a27de0 req-674f42b9-3c44-4041-b749-816ecb69afff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70029374-0ab3-49b9-880e-6a102761c463", "name": "network-vif-unplugged", "status": "completed", "tag": "5d53e751-c135-4aa3-b56f-602088936cc0"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:20.257291 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:43:20.257291 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:43:20.265773 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-2b929227-0351-4a65-a3b2-c023b7a27de0 req-674f42b9-3c44-4041-b749-816ecb69afff service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:20.270998 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-2b929227-0351-4a65-a3b2-c023b7a27de0 req-674f42b9-3c44-4041-b749-816ecb69afff service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:20.277705 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.compute.server_external_events [req-2b929227-0351-4a65-a3b2-c023b7a27de0 req-674f42b9-3c44-4041-b749-816ecb69afff service nova] Unable to find a host for instance 70029374-0ab3-49b9-880e-6a102761c463. Dropping event network-vif-unplugged {{(pid=128719) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 10 11:43:20.280317 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-2b929227-0351-4a65-a3b2-c023b7a27de0 req-674f42b9-3c44-4041-b749-816ecb69afff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.167961 Jan 10 11:43:20.281162 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 442/877] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 170 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 10 11:43:20.538528 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-c0491ea9-4ac1-47f3-8994-d8966c3f2f51 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95f82848-c005-4101-abe5-258217bf61cb"}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:20.539987 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-c0491ea9-4ac1-47f3-8994-d8966c3f2f51 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:20.546193 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c0491ea9-4ac1-47f3-8994-d8966c3f2f51 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:20.552115 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c0491ea9-4ac1-47f3-8994-d8966c3f2f51 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:20.552115 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c0491ea9-4ac1-47f3-8994-d8966c3f2f51 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:20.552115 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c0491ea9-4ac1-47f3-8994-d8966c3f2f51 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:20.581402 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-84ebe59a-c64a-4290-bc7c-e230af8e8d73 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.231137 Jan 10 11:43:20.584065 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 436/878] 10.222.0.20 () {62 vars in 1363 bytes} [Mon Jan 10 11:43:19 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/os-volume_attachments => generated 188 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 10 11:43:20.695894 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-17623303-007f-49f5-83de-b6bff850f88d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:20.696507 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-17623303-007f-49f5-83de-b6bff850f88d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:20.702986 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-17623303-007f-49f5-83de-b6bff850f88d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:20.703496 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-17623303-007f-49f5-83de-b6bff850f88d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:20.704458 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-17623303-007f-49f5-83de-b6bff850f88d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:20.704899 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-17623303-007f-49f5-83de-b6bff850f88d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:20.773220 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-17623303-007f-49f5-83de-b6bff850f88d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:20.781916 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-17623303-007f-49f5-83de-b6bff850f88d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1328 microversion: 2.1 time: 0.089847 Jan 10 11:43:20.782537 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 437/879] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:20 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1328 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:43:20.787081 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a363bd46-ed06-4968-9156-c5ac1326f9cf tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:20.787570 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a363bd46-ed06-4968-9156-c5ac1326f9cf tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:20.793625 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a363bd46-ed06-4968-9156-c5ac1326f9cf tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:20.794071 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a363bd46-ed06-4968-9156-c5ac1326f9cf tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:20.794920 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a363bd46-ed06-4968-9156-c5ac1326f9cf tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:20.795354 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a363bd46-ed06-4968-9156-c5ac1326f9cf tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:21.343229 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-c0491ea9-4ac1-47f3-8994-d8966c3f2f51 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.808242 Jan 10 11:43:21.344087 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 443/880] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jan 10 11:43:20 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments => generated 194 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:43:21.534704 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a363bd46-ed06-4968-9156-c5ac1326f9cf tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/os-volume_attachments/ad370c29-6a85-4b21-bf4d-5c2518c0c832" status: 202 len: 0 microversion: 2.20 time: 0.727363 Jan 10 11:43:21.534704 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 438/881] 10.222.0.20 () {60 vars in 1456 bytes} [Mon Jan 10 11:43:20 2022] DELETE /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/os-volume_attachments/ad370c29-6a85-4b21-bf4d-5c2518c0c832 => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:43:21.604009 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b6000b91-c5b9-423f-8c1e-cd2ea5a957b7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:21.607831 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b6000b91-c5b9-423f-8c1e-cd2ea5a957b7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:21.620256 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b6000b91-c5b9-423f-8c1e-cd2ea5a957b7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:21.620713 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b6000b91-c5b9-423f-8c1e-cd2ea5a957b7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:21.621587 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b6000b91-c5b9-423f-8c1e-cd2ea5a957b7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:21.622613 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b6000b91-c5b9-423f-8c1e-cd2ea5a957b7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:21.800220 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-89f85e77-2b3c-4a32-9071-3521903c3a7f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:21.801642 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-89f85e77-2b3c-4a32-9071-3521903c3a7f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:21.812919 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-89f85e77-2b3c-4a32-9071-3521903c3a7f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:21.814715 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-89f85e77-2b3c-4a32-9071-3521903c3a7f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:21.815815 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-89f85e77-2b3c-4a32-9071-3521903c3a7f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:21.816623 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-89f85e77-2b3c-4a32-9071-3521903c3a7f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:21.919111 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b6000b91-c5b9-423f-8c1e-cd2ea5a957b7 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action" status: 202 len: 0 microversion: 2.20 time: 0.319653 Jan 10 11:43:21.921319 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 444/882] 10.222.0.20 () {62 vars in 1318 bytes} [Mon Jan 10 11:43:21 2022] POST /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:43:21.942475 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e533bbe6-088a-4935-a1a3-7a8eeafd0ba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:21.943633 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-e533bbe6-088a-4935-a1a3-7a8eeafd0ba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:21.952677 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e533bbe6-088a-4935-a1a3-7a8eeafd0ba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:21.953714 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e533bbe6-088a-4935-a1a3-7a8eeafd0ba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:21.954963 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e533bbe6-088a-4935-a1a3-7a8eeafd0ba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:21.955754 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e533bbe6-088a-4935-a1a3-7a8eeafd0ba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:22.047471 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-89f85e77-2b3c-4a32-9071-3521903c3a7f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:22.062694 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-89f85e77-2b3c-4a32-9071-3521903c3a7f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.266208 Jan 10 11:43:22.074099 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 439/883] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:21 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:22.167278 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-e533bbe6-088a-4935-a1a3-7a8eeafd0ba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:22.179164 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-e533bbe6-088a-4935-a1a3-7a8eeafd0ba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:22.182348 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-e533bbe6-088a-4935-a1a3-7a8eeafd0ba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:22.183950 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-e533bbe6-088a-4935-a1a3-7a8eeafd0ba3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1673 microversion: 2.20 time: 0.255610 Jan 10 11:43:22.185645 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 445/884] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:21 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1673 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:23.080210 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e252f6e0-c5c9-42dc-9dcb-cd5996a645b8 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:23.080865 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e252f6e0-c5c9-42dc-9dcb-cd5996a645b8 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:23.088599 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e252f6e0-c5c9-42dc-9dcb-cd5996a645b8 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:23.089054 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e252f6e0-c5c9-42dc-9dcb-cd5996a645b8 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:23.089927 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e252f6e0-c5c9-42dc-9dcb-cd5996a645b8 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:23.090429 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e252f6e0-c5c9-42dc-9dcb-cd5996a645b8 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:23.204292 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-39277a4e-7711-48ef-8b56-779766182c1b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:23.205168 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-39277a4e-7711-48ef-8b56-779766182c1b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:23.212498 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-39277a4e-7711-48ef-8b56-779766182c1b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:23.213066 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-39277a4e-7711-48ef-8b56-779766182c1b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:23.214109 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-39277a4e-7711-48ef-8b56-779766182c1b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:23.214651 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-39277a4e-7711-48ef-8b56-779766182c1b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:23.242730 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-e252f6e0-c5c9-42dc-9dcb-cd5996a645b8 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:23.252127 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e252f6e0-c5c9-42dc-9dcb-cd5996a645b8 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.175859 Jan 10 11:43:23.263789 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 440/885] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:23 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:23.372675 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-39277a4e-7711-48ef-8b56-779766182c1b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:23.387987 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-39277a4e-7711-48ef-8b56-779766182c1b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:23.390796 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-39277a4e-7711-48ef-8b56-779766182c1b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:23.392112 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-39277a4e-7711-48ef-8b56-779766182c1b tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1673 microversion: 2.20 time: 0.192467 Jan 10 11:43:23.393128 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 446/886] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:23 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1673 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:43:24.269956 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e194fa19-dc3b-4366-9c90-e46d5964e201 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:24.270717 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e194fa19-dc3b-4366-9c90-e46d5964e201 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:24.277063 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e194fa19-dc3b-4366-9c90-e46d5964e201 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:24.277519 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e194fa19-dc3b-4366-9c90-e46d5964e201 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:24.278874 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e194fa19-dc3b-4366-9c90-e46d5964e201 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:24.279343 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e194fa19-dc3b-4366-9c90-e46d5964e201 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:24.413685 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-93207bdd-b99d-44ab-8245-c5437d316564 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:24.414452 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-93207bdd-b99d-44ab-8245-c5437d316564 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:24.421914 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-93207bdd-b99d-44ab-8245-c5437d316564 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:24.422406 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-93207bdd-b99d-44ab-8245-c5437d316564 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:24.423198 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-93207bdd-b99d-44ab-8245-c5437d316564 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:24.423628 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-93207bdd-b99d-44ab-8245-c5437d316564 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:24.467996 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-e194fa19-dc3b-4366-9c90-e46d5964e201 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:24.489039 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e194fa19-dc3b-4366-9c90-e46d5964e201 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.218029 Jan 10 11:43:24.489687 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 441/887] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:24 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:24.570253 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-93207bdd-b99d-44ab-8245-c5437d316564 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:24.595223 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-93207bdd-b99d-44ab-8245-c5437d316564 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:24.597568 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-93207bdd-b99d-44ab-8245-c5437d316564 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:24.599237 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-93207bdd-b99d-44ab-8245-c5437d316564 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1673 microversion: 2.20 time: 0.189036 Jan 10 11:43:24.600284 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 447/888] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:24 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1673 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:43:25.509797 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4813009f-3262-4799-b9cb-c3ec038a1e2f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:25.510467 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4813009f-3262-4799-b9cb-c3ec038a1e2f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:25.517228 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4813009f-3262-4799-b9cb-c3ec038a1e2f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:25.517733 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4813009f-3262-4799-b9cb-c3ec038a1e2f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:25.518540 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4813009f-3262-4799-b9cb-c3ec038a1e2f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:25.518982 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4813009f-3262-4799-b9cb-c3ec038a1e2f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:25.647922 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-14f3f358-b6bf-462f-82d8-225aa978c600 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:25.649265 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-14f3f358-b6bf-462f-82d8-225aa978c600 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:25.659869 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-14f3f358-b6bf-462f-82d8-225aa978c600 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:25.660723 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-14f3f358-b6bf-462f-82d8-225aa978c600 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:25.661828 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-14f3f358-b6bf-462f-82d8-225aa978c600 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:25.662564 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-14f3f358-b6bf-462f-82d8-225aa978c600 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:25.734997 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4813009f-3262-4799-b9cb-c3ec038a1e2f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:25.746067 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4813009f-3262-4799-b9cb-c3ec038a1e2f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.243216 Jan 10 11:43:25.748180 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 442/889] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:25 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:25.865562 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-14f3f358-b6bf-462f-82d8-225aa978c600 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:25.875543 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-14f3f358-b6bf-462f-82d8-225aa978c600 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:25.877047 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-14f3f358-b6bf-462f-82d8-225aa978c600 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:25.878246 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-14f3f358-b6bf-462f-82d8-225aa978c600 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1673 microversion: 2.20 time: 0.234097 Jan 10 11:43:25.879210 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 448/890] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:25 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1673 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:43:26.768515 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-20b75172-3370-4215-8681-d34bfbb2dea4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:26.769546 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-20b75172-3370-4215-8681-d34bfbb2dea4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:26.781372 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-20b75172-3370-4215-8681-d34bfbb2dea4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:26.782098 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-20b75172-3370-4215-8681-d34bfbb2dea4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:26.783006 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-20b75172-3370-4215-8681-d34bfbb2dea4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:26.783763 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-20b75172-3370-4215-8681-d34bfbb2dea4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:26.899137 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ac6e7740-2fb2-4b3f-85b4-128d9926bfa9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:26.899754 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ac6e7740-2fb2-4b3f-85b4-128d9926bfa9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:26.906999 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ac6e7740-2fb2-4b3f-85b4-128d9926bfa9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:26.907484 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ac6e7740-2fb2-4b3f-85b4-128d9926bfa9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:26.908285 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ac6e7740-2fb2-4b3f-85b4-128d9926bfa9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:26.908731 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ac6e7740-2fb2-4b3f-85b4-128d9926bfa9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:26.941203 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-20b75172-3370-4215-8681-d34bfbb2dea4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:26.952440 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-20b75172-3370-4215-8681-d34bfbb2dea4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.190841 Jan 10 11:43:26.953324 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 443/891] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:26 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:27.082491 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ac6e7740-2fb2-4b3f-85b4-128d9926bfa9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:27.093705 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ac6e7740-2fb2-4b3f-85b4-128d9926bfa9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:27.095965 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ac6e7740-2fb2-4b3f-85b4-128d9926bfa9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:27.097429 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ac6e7740-2fb2-4b3f-85b4-128d9926bfa9 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1673 microversion: 2.20 time: 0.202814 Jan 10 11:43:27.098520 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 449/892] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:26 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1673 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:27.972966 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-520bdf70-b4e7-4331-a378-55b2c43394f9 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:27.973674 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-520bdf70-b4e7-4331-a378-55b2c43394f9 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:27.979963 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-520bdf70-b4e7-4331-a378-55b2c43394f9 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:27.980424 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-520bdf70-b4e7-4331-a378-55b2c43394f9 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:27.981975 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-520bdf70-b4e7-4331-a378-55b2c43394f9 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:27.982754 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-520bdf70-b4e7-4331-a378-55b2c43394f9 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:28.127229 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2902a2d4-17e7-4b27-92da-c43f77edf353 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:28.129387 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2902a2d4-17e7-4b27-92da-c43f77edf353 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:28.141547 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2902a2d4-17e7-4b27-92da-c43f77edf353 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:28.143132 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-520bdf70-b4e7-4331-a378-55b2c43394f9 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:28.143563 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2902a2d4-17e7-4b27-92da-c43f77edf353 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:28.145180 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2902a2d4-17e7-4b27-92da-c43f77edf353 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:28.145803 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2902a2d4-17e7-4b27-92da-c43f77edf353 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:28.151841 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-520bdf70-b4e7-4331-a378-55b2c43394f9 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.182595 Jan 10 11:43:28.152832 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 444/893] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:27 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:28.325334 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2902a2d4-17e7-4b27-92da-c43f77edf353 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:28.333941 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2902a2d4-17e7-4b27-92da-c43f77edf353 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:28.335475 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2902a2d4-17e7-4b27-92da-c43f77edf353 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:28.336626 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2902a2d4-17e7-4b27-92da-c43f77edf353 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1673 microversion: 2.20 time: 0.216211 Jan 10 11:43:28.337789 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 450/894] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:28 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1673 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:29.177564 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2f8cb7d6-8fe9-439f-bd11-230faf071e91 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:29.178873 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2f8cb7d6-8fe9-439f-bd11-230faf071e91 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:29.187191 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2f8cb7d6-8fe9-439f-bd11-230faf071e91 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:29.187926 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2f8cb7d6-8fe9-439f-bd11-230faf071e91 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:29.189013 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2f8cb7d6-8fe9-439f-bd11-230faf071e91 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:29.191756 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2f8cb7d6-8fe9-439f-bd11-230faf071e91 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:29.359836 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7c40cce6-e33f-4494-9506-cc3185c8bc53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:29.366273 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7c40cce6-e33f-4494-9506-cc3185c8bc53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:29.385568 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7c40cce6-e33f-4494-9506-cc3185c8bc53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:29.386636 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7c40cce6-e33f-4494-9506-cc3185c8bc53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:29.388840 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7c40cce6-e33f-4494-9506-cc3185c8bc53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:29.389672 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7c40cce6-e33f-4494-9506-cc3185c8bc53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:29.424354 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2f8cb7d6-8fe9-439f-bd11-230faf071e91 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:29.432690 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2f8cb7d6-8fe9-439f-bd11-230faf071e91 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.259480 Jan 10 11:43:29.433543 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 445/895] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:29 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:29.564340 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-7c40cce6-e33f-4494-9506-cc3185c8bc53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:29.579382 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-7c40cce6-e33f-4494-9506-cc3185c8bc53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:29.581075 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-7c40cce6-e33f-4494-9506-cc3185c8bc53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:29.582284 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7c40cce6-e33f-4494-9506-cc3185c8bc53 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1673 microversion: 2.20 time: 0.230339 Jan 10 11:43:29.583187 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 451/896] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:29 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1673 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:30.453358 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f39c1050-0663-4ac2-94e2-d6808255a3b5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:30.453958 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f39c1050-0663-4ac2-94e2-d6808255a3b5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:30.460699 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f39c1050-0663-4ac2-94e2-d6808255a3b5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:30.461153 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f39c1050-0663-4ac2-94e2-d6808255a3b5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:30.461959 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f39c1050-0663-4ac2-94e2-d6808255a3b5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:30.462426 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f39c1050-0663-4ac2-94e2-d6808255a3b5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:30.601046 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-82d4f81f-c9b9-4e29-9068-3463b4a4e5cf tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:30.601876 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-82d4f81f-c9b9-4e29-9068-3463b4a4e5cf tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:30.610157 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-82d4f81f-c9b9-4e29-9068-3463b4a4e5cf tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:30.610555 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-82d4f81f-c9b9-4e29-9068-3463b4a4e5cf tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:30.619022 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-82d4f81f-c9b9-4e29-9068-3463b4a4e5cf tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:30.620012 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-82d4f81f-c9b9-4e29-9068-3463b4a4e5cf tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:30.644734 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f39c1050-0663-4ac2-94e2-d6808255a3b5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:30.657696 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f39c1050-0663-4ac2-94e2-d6808255a3b5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.207726 Jan 10 11:43:30.659120 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 446/897] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:30 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:43:30.819036 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-82d4f81f-c9b9-4e29-9068-3463b4a4e5cf tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:30.833526 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-82d4f81f-c9b9-4e29-9068-3463b4a4e5cf tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:30.835173 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-82d4f81f-c9b9-4e29-9068-3463b4a4e5cf tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:30.836403 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-82d4f81f-c9b9-4e29-9068-3463b4a4e5cf tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1675 microversion: 2.20 time: 0.239048 Jan 10 11:43:30.837073 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 452/898] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:30 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1675 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:43:31.383201 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-5109ece8-cc23-4811-8bf0-57528f8a7dbd req-45f1f3ec-559c-4383-98cb-b637cfcb79f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec5d091-4d75-4338-b116-9d3966808486", "tag": "ded3fe31-2cd9-4cc2-84d1-829b49e7753f"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:31.386028 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:43:31.386028 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:43:31.395430 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-5109ece8-cc23-4811-8bf0-57528f8a7dbd req-45f1f3ec-559c-4383-98cb-b637cfcb79f0 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:31.395886 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-5109ece8-cc23-4811-8bf0-57528f8a7dbd req-45f1f3ec-559c-4383-98cb-b637cfcb79f0 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:31.421674 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-5109ece8-cc23-4811-8bf0-57528f8a7dbd req-45f1f3ec-559c-4383-98cb-b637cfcb79f0 service nova] Creating event network-changed:ded3fe31-2cd9-4cc2-84d1-829b49e7753f for instance 6ec5d091-4d75-4338-b116-9d3966808486 on hv-cinder-maste Jan 10 11:43:31.427641 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-5109ece8-cc23-4811-8bf0-57528f8a7dbd req-45f1f3ec-559c-4383-98cb-b637cfcb79f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155482 Jan 10 11:43:31.428496 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 447/899] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:43:31.676142 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3d2b4157-1296-4356-a9c5-398f3d4f277d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:31.676883 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-3d2b4157-1296-4356-a9c5-398f3d4f277d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:31.685760 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3d2b4157-1296-4356-a9c5-398f3d4f277d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:31.686231 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3d2b4157-1296-4356-a9c5-398f3d4f277d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:31.687028 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3d2b4157-1296-4356-a9c5-398f3d4f277d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:31.687530 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3d2b4157-1296-4356-a9c5-398f3d4f277d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:31.858687 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-3d2b4157-1296-4356-a9c5-398f3d4f277d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:31.861735 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c183947b-b06c-4ebb-a0ad-303833ba5ff3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:31.866748 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c183947b-b06c-4ebb-a0ad-303833ba5ff3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:31.869605 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3d2b4157-1296-4356-a9c5-398f3d4f277d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.197078 Jan 10 11:43:31.870931 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 453/900] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:31 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:31.880390 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c183947b-b06c-4ebb-a0ad-303833ba5ff3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:31.886963 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c183947b-b06c-4ebb-a0ad-303833ba5ff3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:31.889316 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c183947b-b06c-4ebb-a0ad-303833ba5ff3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:31.889933 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c183947b-b06c-4ebb-a0ad-303833ba5ff3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:32.065245 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c183947b-b06c-4ebb-a0ad-303833ba5ff3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:32.077436 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c183947b-b06c-4ebb-a0ad-303833ba5ff3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:32.079019 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c183947b-b06c-4ebb-a0ad-303833ba5ff3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:32.080210 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c183947b-b06c-4ebb-a0ad-303833ba5ff3 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1731 microversion: 2.20 time: 0.227726 Jan 10 11:43:32.081319 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 448/901] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:31 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1731 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:32.890901 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-46b09449-143a-430c-9a44-3ba684ae75f2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:32.892350 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-46b09449-143a-430c-9a44-3ba684ae75f2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:32.904435 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-46b09449-143a-430c-9a44-3ba684ae75f2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:32.905243 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-46b09449-143a-430c-9a44-3ba684ae75f2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:32.907684 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-46b09449-143a-430c-9a44-3ba684ae75f2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:32.908314 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-46b09449-143a-430c-9a44-3ba684ae75f2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:33.105495 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-cd6de266-b699-46fe-b230-12e6866f408c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:33.107577 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-cd6de266-b699-46fe-b230-12e6866f408c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:33.120110 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cd6de266-b699-46fe-b230-12e6866f408c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:33.120951 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cd6de266-b699-46fe-b230-12e6866f408c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:33.122424 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cd6de266-b699-46fe-b230-12e6866f408c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:33.123210 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-cd6de266-b699-46fe-b230-12e6866f408c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:33.140170 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-46b09449-143a-430c-9a44-3ba684ae75f2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:33.175719 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-46b09449-143a-430c-9a44-3ba684ae75f2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.291006 Jan 10 11:43:33.180615 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 454/902] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:32 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:33.370754 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-cd6de266-b699-46fe-b230-12e6866f408c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:33.402039 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-cd6de266-b699-46fe-b230-12e6866f408c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:33.405052 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-cd6de266-b699-46fe-b230-12e6866f408c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:33.408882 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-cd6de266-b699-46fe-b230-12e6866f408c tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1731 microversion: 2.20 time: 0.308115 Jan 10 11:43:33.410489 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 449/903] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:33 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1731 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:34.204269 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9a9973fc-5d57-4ea9-8753-b2558c649fe6 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:34.205807 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9a9973fc-5d57-4ea9-8753-b2558c649fe6 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:34.212915 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9a9973fc-5d57-4ea9-8753-b2558c649fe6 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:34.213475 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9a9973fc-5d57-4ea9-8753-b2558c649fe6 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:34.214388 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9a9973fc-5d57-4ea9-8753-b2558c649fe6 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:34.214899 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9a9973fc-5d57-4ea9-8753-b2558c649fe6 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:34.383630 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9a9973fc-5d57-4ea9-8753-b2558c649fe6 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:34.396993 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9a9973fc-5d57-4ea9-8753-b2558c649fe6 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.197462 Jan 10 11:43:34.404141 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 455/904] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:34 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:34.427608 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-fcfe8626-ee21-4d86-9ed6-da43d409b009 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:34.428219 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-fcfe8626-ee21-4d86-9ed6-da43d409b009 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:34.449446 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fcfe8626-ee21-4d86-9ed6-da43d409b009 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:34.449940 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fcfe8626-ee21-4d86-9ed6-da43d409b009 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:34.451127 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fcfe8626-ee21-4d86-9ed6-da43d409b009 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:34.451742 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fcfe8626-ee21-4d86-9ed6-da43d409b009 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:34.665828 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-fcfe8626-ee21-4d86-9ed6-da43d409b009 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:34.677471 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-fcfe8626-ee21-4d86-9ed6-da43d409b009 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:34.679311 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-fcfe8626-ee21-4d86-9ed6-da43d409b009 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:34.680769 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-fcfe8626-ee21-4d86-9ed6-da43d409b009 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1731 microversion: 2.20 time: 0.256705 Jan 10 11:43:34.681825 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 450/905] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:34 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1731 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:35.415672 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-49f51885-368d-4f97-aed3-0d3b83efcc95 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:35.416293 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-49f51885-368d-4f97-aed3-0d3b83efcc95 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:35.423539 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-49f51885-368d-4f97-aed3-0d3b83efcc95 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:35.424228 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-49f51885-368d-4f97-aed3-0d3b83efcc95 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:35.425198 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-49f51885-368d-4f97-aed3-0d3b83efcc95 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:35.425710 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-49f51885-368d-4f97-aed3-0d3b83efcc95 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:35.569684 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-49f51885-368d-4f97-aed3-0d3b83efcc95 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:35.577541 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-49f51885-368d-4f97-aed3-0d3b83efcc95 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.165573 Jan 10 11:43:35.578109 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 456/906] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:35 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:35.702768 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f3e86b75-3a0b-4299-810e-0a6d30b94008 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:35.704330 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f3e86b75-3a0b-4299-810e-0a6d30b94008 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:35.713830 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f3e86b75-3a0b-4299-810e-0a6d30b94008 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:35.714722 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f3e86b75-3a0b-4299-810e-0a6d30b94008 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:35.716087 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f3e86b75-3a0b-4299-810e-0a6d30b94008 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:35.717053 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f3e86b75-3a0b-4299-810e-0a6d30b94008 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:35.891706 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f3e86b75-3a0b-4299-810e-0a6d30b94008 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:35.901648 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f3e86b75-3a0b-4299-810e-0a6d30b94008 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:35.904292 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f3e86b75-3a0b-4299-810e-0a6d30b94008 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:35.905774 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f3e86b75-3a0b-4299-810e-0a6d30b94008 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1731 microversion: 2.20 time: 0.209105 Jan 10 11:43:35.917477 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 451/907] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:35 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1731 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:36.448547 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-ca049cea-5846-4e5b-a509-1144bb55da0c req-a60fc532-c9f2-4dc0-9b70-2f00692450fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec5d091-4d75-4338-b116-9d3966808486", "name": "network-vif-plugged", "status": "completed", "tag": "ded3fe31-2cd9-4cc2-84d1-829b49e7753f"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:36.448547 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:43:36.448547 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:43:36.448547 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-ca049cea-5846-4e5b-a509-1144bb55da0c req-a60fc532-c9f2-4dc0-9b70-2f00692450fc service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:36.448547 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-ca049cea-5846-4e5b-a509-1144bb55da0c req-a60fc532-c9f2-4dc0-9b70-2f00692450fc service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:36.449691 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-ca049cea-5846-4e5b-a509-1144bb55da0c req-a60fc532-c9f2-4dc0-9b70-2f00692450fc service nova] Creating event network-vif-plugged:ded3fe31-2cd9-4cc2-84d1-829b49e7753f for instance 6ec5d091-4d75-4338-b116-9d3966808486 on hv-cinder-maste Jan 10 11:43:36.452291 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-ca049cea-5846-4e5b-a509-1144bb55da0c req-a60fc532-c9f2-4dc0-9b70-2f00692450fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031038 Jan 10 11:43:36.452990 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 457/908] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:43:36.595460 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-52ca79ea-053d-438c-ab34-a109783e92fe tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:36.596304 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-52ca79ea-053d-438c-ab34-a109783e92fe tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:36.603849 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-52ca79ea-053d-438c-ab34-a109783e92fe tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:36.604311 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-52ca79ea-053d-438c-ab34-a109783e92fe tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:36.605106 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-52ca79ea-053d-438c-ab34-a109783e92fe tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:36.605546 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-52ca79ea-053d-438c-ab34-a109783e92fe tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:36.778958 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-52ca79ea-053d-438c-ab34-a109783e92fe tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:36.787697 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-52ca79ea-053d-438c-ab34-a109783e92fe tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.197247 Jan 10 11:43:36.798028 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 452/909] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:36 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:36.926236 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-1ad07bae-ddb6-4da8-ba49-f19feacdc93f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:37.046768 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-1ad07bae-ddb6-4da8-ba49-f19feacdc93f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:37.046768 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1ad07bae-ddb6-4da8-ba49-f19feacdc93f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:37.046768 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1ad07bae-ddb6-4da8-ba49-f19feacdc93f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:37.046768 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1ad07bae-ddb6-4da8-ba49-f19feacdc93f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:37.047483 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1ad07bae-ddb6-4da8-ba49-f19feacdc93f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:37.072971 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-1ad07bae-ddb6-4da8-ba49-f19feacdc93f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:37.082374 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-1ad07bae-ddb6-4da8-ba49-f19feacdc93f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:37.115240 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-1ad07bae-ddb6-4da8-ba49-f19feacdc93f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:37.115240 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-1ad07bae-ddb6-4da8-ba49-f19feacdc93f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1731 microversion: 2.20 time: 0.163342 Jan 10 11:43:37.115240 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 458/910] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:36 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:37.805254 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-5e143f83-d4f2-46af-ad7a-fda20b204d4b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:37.805858 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-5e143f83-d4f2-46af-ad7a-fda20b204d4b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:37.812616 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5e143f83-d4f2-46af-ad7a-fda20b204d4b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:37.813074 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5e143f83-d4f2-46af-ad7a-fda20b204d4b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:37.813880 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5e143f83-d4f2-46af-ad7a-fda20b204d4b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:37.814352 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5e143f83-d4f2-46af-ad7a-fda20b204d4b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:37.974038 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-5e143f83-d4f2-46af-ad7a-fda20b204d4b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:37.982842 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-5e143f83-d4f2-46af-ad7a-fda20b204d4b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.181449 Jan 10 11:43:37.983422 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 453/911] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:37 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:38.132496 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9bc8331e-f97c-4440-82ae-c5819d3c8cac tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:38.133071 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9bc8331e-f97c-4440-82ae-c5819d3c8cac tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:38.140145 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9bc8331e-f97c-4440-82ae-c5819d3c8cac tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:38.140593 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9bc8331e-f97c-4440-82ae-c5819d3c8cac tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:38.141375 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9bc8331e-f97c-4440-82ae-c5819d3c8cac tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:38.141816 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9bc8331e-f97c-4440-82ae-c5819d3c8cac tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:38.283931 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9bc8331e-f97c-4440-82ae-c5819d3c8cac tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:38.292425 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9bc8331e-f97c-4440-82ae-c5819d3c8cac tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:38.293948 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9bc8331e-f97c-4440-82ae-c5819d3c8cac tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:38.295503 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9bc8331e-f97c-4440-82ae-c5819d3c8cac tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1731 microversion: 2.20 time: 0.167158 Jan 10 11:43:38.296439 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 459/912] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:38 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:39.000804 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e5cec600-51a3-4b16-9b4b-02e48ab4dae4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:39.001698 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e5cec600-51a3-4b16-9b4b-02e48ab4dae4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:39.008585 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e5cec600-51a3-4b16-9b4b-02e48ab4dae4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:39.009037 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e5cec600-51a3-4b16-9b4b-02e48ab4dae4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:39.009888 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e5cec600-51a3-4b16-9b4b-02e48ab4dae4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:39.010354 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e5cec600-51a3-4b16-9b4b-02e48ab4dae4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:39.150711 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-e5cec600-51a3-4b16-9b4b-02e48ab4dae4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:39.160331 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e5cec600-51a3-4b16-9b4b-02e48ab4dae4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.164099 Jan 10 11:43:39.161259 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 454/913] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:38 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:39.313609 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-bd2bd4e3-4862-4047-a925-41c631a85e85 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:39.315060 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-bd2bd4e3-4862-4047-a925-41c631a85e85 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:39.321981 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bd2bd4e3-4862-4047-a925-41c631a85e85 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:39.322726 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bd2bd4e3-4862-4047-a925-41c631a85e85 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:39.323706 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bd2bd4e3-4862-4047-a925-41c631a85e85 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:39.324321 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bd2bd4e3-4862-4047-a925-41c631a85e85 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:39.471577 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-bd2bd4e3-4862-4047-a925-41c631a85e85 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:39.480723 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-bd2bd4e3-4862-4047-a925-41c631a85e85 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:39.483124 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-bd2bd4e3-4862-4047-a925-41c631a85e85 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:39.484411 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-bd2bd4e3-4862-4047-a925-41c631a85e85 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1731 microversion: 2.20 time: 0.175434 Jan 10 11:43:39.485981 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 460/914] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:39 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:40.179296 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-5e62e585-d4fc-48fd-9767-9fa203f7d06d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:40.180180 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-5e62e585-d4fc-48fd-9767-9fa203f7d06d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:40.187221 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5e62e585-d4fc-48fd-9767-9fa203f7d06d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:40.188878 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5e62e585-d4fc-48fd-9767-9fa203f7d06d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:40.189891 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5e62e585-d4fc-48fd-9767-9fa203f7d06d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:40.190367 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5e62e585-d4fc-48fd-9767-9fa203f7d06d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:40.390543 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-5e62e585-d4fc-48fd-9767-9fa203f7d06d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:40.404481 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-5e62e585-d4fc-48fd-9767-9fa203f7d06d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.229833 Jan 10 11:43:40.405081 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 455/915] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:40 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:40.503790 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-cbd661a6-0dfb-410c-828d-0395dfa37b59 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:40.504374 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-cbd661a6-0dfb-410c-828d-0395dfa37b59 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:40.512973 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cbd661a6-0dfb-410c-828d-0395dfa37b59 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:40.513690 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cbd661a6-0dfb-410c-828d-0395dfa37b59 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:40.514745 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cbd661a6-0dfb-410c-828d-0395dfa37b59 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:40.515180 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cbd661a6-0dfb-410c-828d-0395dfa37b59 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:40.714798 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-cbd661a6-0dfb-410c-828d-0395dfa37b59 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:40.723834 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-cbd661a6-0dfb-410c-828d-0395dfa37b59 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:40.726247 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-cbd661a6-0dfb-410c-828d-0395dfa37b59 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:40.728228 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-cbd661a6-0dfb-410c-828d-0395dfa37b59 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1731 microversion: 2.20 time: 0.226512 Jan 10 11:43:40.728228 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 461/916] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:40 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1731 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:41.421776 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c9b75e1f-2247-4128-bed9-d312a3bc1567 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:41.422578 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c9b75e1f-2247-4128-bed9-d312a3bc1567 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:41.428952 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c9b75e1f-2247-4128-bed9-d312a3bc1567 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:41.429409 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c9b75e1f-2247-4128-bed9-d312a3bc1567 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:41.430199 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c9b75e1f-2247-4128-bed9-d312a3bc1567 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:41.430666 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c9b75e1f-2247-4128-bed9-d312a3bc1567 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:41.572253 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c9b75e1f-2247-4128-bed9-d312a3bc1567 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:41.586147 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c9b75e1f-2247-4128-bed9-d312a3bc1567 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.168320 Jan 10 11:43:41.586969 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 456/917] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:41 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:41.746659 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-8f4e44d8-3b32-42c4-92e7-e01acd416388 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:41.748795 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-8f4e44d8-3b32-42c4-92e7-e01acd416388 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:41.764550 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8f4e44d8-3b32-42c4-92e7-e01acd416388 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:41.768969 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8f4e44d8-3b32-42c4-92e7-e01acd416388 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:41.768969 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8f4e44d8-3b32-42c4-92e7-e01acd416388 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:41.768969 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8f4e44d8-3b32-42c4-92e7-e01acd416388 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:41.929203 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-8f4e44d8-3b32-42c4-92e7-e01acd416388 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:41.929423 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-8f4e44d8-3b32-42c4-92e7-e01acd416388 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:41.930959 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-8f4e44d8-3b32-42c4-92e7-e01acd416388 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:41.932149 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-8f4e44d8-3b32-42c4-92e7-e01acd416388 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1731 microversion: 2.20 time: 0.189935 Jan 10 11:43:41.932720 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 462/918] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:41 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:42.601653 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-32dc457f-e678-4d49-a5c7-144e7164a6d0 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:42.602292 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-32dc457f-e678-4d49-a5c7-144e7164a6d0 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:42.609041 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-32dc457f-e678-4d49-a5c7-144e7164a6d0 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:42.609530 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-32dc457f-e678-4d49-a5c7-144e7164a6d0 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:42.610416 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-32dc457f-e678-4d49-a5c7-144e7164a6d0 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:42.610852 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-32dc457f-e678-4d49-a5c7-144e7164a6d0 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:42.740515 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-32dc457f-e678-4d49-a5c7-144e7164a6d0 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:42.748501 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-32dc457f-e678-4d49-a5c7-144e7164a6d0 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1358 microversion: 2.1 time: 0.150274 Jan 10 11:43:42.749083 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 457/919] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:42 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:42.914596 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f0b5705a-92cf-4930-bf45-99cf34f02d5a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:42.915570 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f0b5705a-92cf-4930-bf45-99cf34f02d5a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:42.922145 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f0b5705a-92cf-4930-bf45-99cf34f02d5a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:42.922643 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f0b5705a-92cf-4930-bf45-99cf34f02d5a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:42.923445 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f0b5705a-92cf-4930-bf45-99cf34f02d5a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:42.923882 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f0b5705a-92cf-4930-bf45-99cf34f02d5a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:42.951663 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-91350bb1-0275-4689-82b8-7c150231c357 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:42.952321 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-91350bb1-0275-4689-82b8-7c150231c357 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:42.957131 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f0b5705a-92cf-4930-bf45-99cf34f02d5a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046424 Jan 10 11:43:42.959240 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 463/920] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:43:42 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:43:42.961749 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-91350bb1-0275-4689-82b8-7c150231c357 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:42.962234 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-91350bb1-0275-4689-82b8-7c150231c357 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:42.963123 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-91350bb1-0275-4689-82b8-7c150231c357 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:42.963599 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-91350bb1-0275-4689-82b8-7c150231c357 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:42.967586 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b3044eaf-f677-44a3-8a5c-30ea71ad6f74 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:42.968307 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b3044eaf-f677-44a3-8a5c-30ea71ad6f74 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:42.974432 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b3044eaf-f677-44a3-8a5c-30ea71ad6f74 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:42.975526 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b3044eaf-f677-44a3-8a5c-30ea71ad6f74 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:42.976333 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b3044eaf-f677-44a3-8a5c-30ea71ad6f74 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:42.976835 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b3044eaf-f677-44a3-8a5c-30ea71ad6f74 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:43.007122 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b3044eaf-f677-44a3-8a5c-30ea71ad6f74 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments/95f82848-c005-4101-abe5-258217bf61cb" status: 200 len: 194 microversion: 2.1 time: 0.043178 Jan 10 11:43:43.007777 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 464/921] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Jan 10 11:43:42 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments/95f82848-c005-4101-abe5-258217bf61cb => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:43:43.103980 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-91350bb1-0275-4689-82b8-7c150231c357 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:43.112774 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-91350bb1-0275-4689-82b8-7c150231c357 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:43.114608 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-91350bb1-0275-4689-82b8-7c150231c357 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:43.115778 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-91350bb1-0275-4689-82b8-7c150231c357 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1731 microversion: 2.20 time: 0.168116 Jan 10 11:43:43.116559 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 458/922] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:42 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:43.765913 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-c277baf8-f711-4df4-96bf-925640f5e73a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:43.766561 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-c277baf8-f711-4df4-96bf-925640f5e73a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:43.772590 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c277baf8-f711-4df4-96bf-925640f5e73a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:43.773042 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c277baf8-f711-4df4-96bf-925640f5e73a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:43.773836 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c277baf8-f711-4df4-96bf-925640f5e73a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:43.774314 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c277baf8-f711-4df4-96bf-925640f5e73a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:43.908747 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-c277baf8-f711-4df4-96bf-925640f5e73a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:43.916216 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-c277baf8-f711-4df4-96bf-925640f5e73a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1549 microversion: 2.1 time: 0.155090 Jan 10 11:43:43.916794 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 465/923] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:43 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:43.932144 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-104b96d0-acb1-476b-b2db-ad988aa774f5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:43.932790 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-104b96d0-acb1-476b-b2db-ad988aa774f5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:43.939712 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-104b96d0-acb1-476b-b2db-ad988aa774f5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:43.940171 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-104b96d0-acb1-476b-b2db-ad988aa774f5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:43.940952 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-104b96d0-acb1-476b-b2db-ad988aa774f5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:43.941388 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-104b96d0-acb1-476b-b2db-ad988aa774f5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:44.079387 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-104b96d0-acb1-476b-b2db-ad988aa774f5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:44.086894 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-104b96d0-acb1-476b-b2db-ad988aa774f5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1549 microversion: 2.1 time: 0.158381 Jan 10 11:43:44.087474 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 459/924] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:43 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:43:44.102773 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-cd8d61e2-a696-4ab5-b861-149374f3584b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:44.106160 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:43:44.106160 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:43:44.107239 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-cd8d61e2-a696-4ab5-b861-149374f3584b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:44.107899 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-cd8d61e2-a696-4ab5-b861-149374f3584b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Searching by: {'deleted': False, 'project_id': 'e45c180d632e41cdb97880086d7705c2'} {{(pid=128719) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 10 11:43:44.115050 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cd8d61e2-a696-4ab5-b861-149374f3584b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:44.115498 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cd8d61e2-a696-4ab5-b861-149374f3584b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:44.116306 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cd8d61e2-a696-4ab5-b861-149374f3584b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:44.116744 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cd8d61e2-a696-4ab5-b861-149374f3584b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:44.141196 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-79b44f10-bad1-412b-aa21-a0a20a602f36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:44.142086 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-79b44f10-bad1-412b-aa21-a0a20a602f36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:44.148002 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-79b44f10-bad1-412b-aa21-a0a20a602f36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:44.148467 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-79b44f10-bad1-412b-aa21-a0a20a602f36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:44.149257 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-79b44f10-bad1-412b-aa21-a0a20a602f36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:44.149693 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-79b44f10-bad1-412b-aa21-a0a20a602f36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:44.222485 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.multi_cell_list [None req-cd8d61e2-a696-4ab5-b861-149374f3584b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128719) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 10 11:43:44.298764 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-79b44f10-bad1-412b-aa21-a0a20a602f36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:44.307464 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-79b44f10-bad1-412b-aa21-a0a20a602f36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:44.309420 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-79b44f10-bad1-412b-aa21-a0a20a602f36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:44.310991 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-79b44f10-bad1-412b-aa21-a0a20a602f36 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1731 microversion: 2.20 time: 0.179905 Jan 10 11:43:44.317654 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 460/925] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:44 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:43:44.503561 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-cd8d61e2-a696-4ab5-b861-149374f3584b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.404333 Jan 10 11:43:44.504261 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 466/926] 10.222.0.20 () {58 vars in 1124 bytes} [Mon Jan 10 11:43:44 2022] GET /compute/v2.1/servers => generated 342 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:43:44.514194 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-bf1b4abc-1cdb-4cbe-9eef-cf93561277bc tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:44.515050 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-bf1b4abc-1cdb-4cbe-9eef-cf93561277bc tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:44.521335 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bf1b4abc-1cdb-4cbe-9eef-cf93561277bc tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:44.522026 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bf1b4abc-1cdb-4cbe-9eef-cf93561277bc tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:44.522852 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bf1b4abc-1cdb-4cbe-9eef-cf93561277bc tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:44.523289 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bf1b4abc-1cdb-4cbe-9eef-cf93561277bc tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:44.627498 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-836a3983-9a9a-4368-9ae8-a4d11bbb3536 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee047682-a0cf-45f8-bc0e-e0efc4000c1c"}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:44.628627 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-836a3983-9a9a-4368-9ae8-a4d11bbb3536 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:44.634537 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-836a3983-9a9a-4368-9ae8-a4d11bbb3536 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:44.634995 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-836a3983-9a9a-4368-9ae8-a4d11bbb3536 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:44.635796 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-836a3983-9a9a-4368-9ae8-a4d11bbb3536 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:44.636236 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-836a3983-9a9a-4368-9ae8-a4d11bbb3536 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:44.660237 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-bf1b4abc-1cdb-4cbe-9eef-cf93561277bc tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:44.667942 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-bf1b4abc-1cdb-4cbe-9eef-cf93561277bc tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1549 microversion: 2.1 time: 0.157360 Jan 10 11:43:44.668667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 461/927] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:43:44 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:43:45.329991 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-5a25efd4-c794-4811-ac0f-1570514c42ad tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:45.331402 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-5a25efd4-c794-4811-ac0f-1570514c42ad tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:45.338117 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5a25efd4-c794-4811-ac0f-1570514c42ad tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:45.338614 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5a25efd4-c794-4811-ac0f-1570514c42ad tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:45.339415 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5a25efd4-c794-4811-ac0f-1570514c42ad tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:45.339864 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5a25efd4-c794-4811-ac0f-1570514c42ad tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:45.426447 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-836a3983-9a9a-4368-9ae8-a4d11bbb3536 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.802835 Jan 10 11:43:45.427093 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 467/928] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jan 10 11:43:44 2022] POST /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments => generated 194 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:43:45.487488 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-5a25efd4-c794-4811-ac0f-1570514c42ad tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:45.496223 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-5a25efd4-c794-4811-ac0f-1570514c42ad tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:45.497830 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-5a25efd4-c794-4811-ac0f-1570514c42ad tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:45.499024 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-5a25efd4-c794-4811-ac0f-1570514c42ad tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1731 microversion: 2.20 time: 0.173625 Jan 10 11:43:45.499585 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 462/929] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:45 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 10 11:43:46.320205 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-152b06bf-a260-46bf-91b1-95bbf8ccd37d req-0195cc85-4699-4f36-b1ea-780cc00738ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70029374-0ab3-49b9-880e-6a102761c463", "name": "network-vif-plugged", "status": "completed", "tag": "5d53e751-c135-4aa3-b56f-602088936cc0"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:46.321855 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:43:46.321855 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:43:46.354927 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-152b06bf-a260-46bf-91b1-95bbf8ccd37d req-0195cc85-4699-4f36-b1ea-780cc00738ee service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:46.355396 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-152b06bf-a260-46bf-91b1-95bbf8ccd37d req-0195cc85-4699-4f36-b1ea-780cc00738ee service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:46.367493 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-152b06bf-a260-46bf-91b1-95bbf8ccd37d req-0195cc85-4699-4f36-b1ea-780cc00738ee service nova] Creating event network-vif-plugged:5d53e751-c135-4aa3-b56f-602088936cc0 for instance 70029374-0ab3-49b9-880e-6a102761c463 on hv-cinder-maste Jan 10 11:43:46.373364 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-152b06bf-a260-46bf-91b1-95bbf8ccd37d req-0195cc85-4699-4f36-b1ea-780cc00738ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057597 Jan 10 11:43:46.373972 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 468/930] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:43:46.519204 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-89df88cb-b1a6-48d0-9332-a13792599307 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:46.520054 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-89df88cb-b1a6-48d0-9332-a13792599307 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:46.526952 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-89df88cb-b1a6-48d0-9332-a13792599307 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:46.527437 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-89df88cb-b1a6-48d0-9332-a13792599307 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:46.528249 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-89df88cb-b1a6-48d0-9332-a13792599307 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:46.530014 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-89df88cb-b1a6-48d0-9332-a13792599307 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:46.591910 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-fa475481-e20f-4a08-9495-0be56f475224 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ff704e7-10fe-4df0-a138-1adb7809a92b"}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:43:46.593279 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-fa475481-e20f-4a08-9495-0be56f475224 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:46.599616 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fa475481-e20f-4a08-9495-0be56f475224 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:46.609370 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fa475481-e20f-4a08-9495-0be56f475224 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:46.609370 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fa475481-e20f-4a08-9495-0be56f475224 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:46.609370 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fa475481-e20f-4a08-9495-0be56f475224 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:46.677044 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-89df88cb-b1a6-48d0-9332-a13792599307 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:46.685955 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-89df88cb-b1a6-48d0-9332-a13792599307 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:46.687118 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-89df88cb-b1a6-48d0-9332-a13792599307 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:46.688294 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-89df88cb-b1a6-48d0-9332-a13792599307 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1731 microversion: 2.20 time: 0.173607 Jan 10 11:43:46.688857 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 463/931] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:46 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:47.478839 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-fa475481-e20f-4a08-9495-0be56f475224 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "POST /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.891330 Jan 10 11:43:47.479378 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 469/932] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jan 10 11:43:46 2022] POST /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/os-volume_attachments => generated 194 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:43:47.707028 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3bd709c5-93de-46ea-a59a-55e39a0309cd tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:47.707641 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3bd709c5-93de-46ea-a59a-55e39a0309cd tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:47.713900 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3bd709c5-93de-46ea-a59a-55e39a0309cd tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:47.714394 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3bd709c5-93de-46ea-a59a-55e39a0309cd tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:47.715199 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3bd709c5-93de-46ea-a59a-55e39a0309cd tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:47.715639 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3bd709c5-93de-46ea-a59a-55e39a0309cd tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:47.848267 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3bd709c5-93de-46ea-a59a-55e39a0309cd tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:47.856427 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3bd709c5-93de-46ea-a59a-55e39a0309cd tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:47.857989 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3bd709c5-93de-46ea-a59a-55e39a0309cd tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:47.859168 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3bd709c5-93de-46ea-a59a-55e39a0309cd tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1731 microversion: 2.20 time: 0.155868 Jan 10 11:43:47.859728 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 464/933] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:47 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:48.878613 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9a6e7f76-6d8c-4ff8-ac10-bbab396ae247 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:48.879309 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9a6e7f76-6d8c-4ff8-ac10-bbab396ae247 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:48.907330 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9a6e7f76-6d8c-4ff8-ac10-bbab396ae247 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:48.907330 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9a6e7f76-6d8c-4ff8-ac10-bbab396ae247 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:48.907330 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9a6e7f76-6d8c-4ff8-ac10-bbab396ae247 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:48.907330 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9a6e7f76-6d8c-4ff8-ac10-bbab396ae247 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:49.037799 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9a6e7f76-6d8c-4ff8-ac10-bbab396ae247 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:49.046754 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9a6e7f76-6d8c-4ff8-ac10-bbab396ae247 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:49.048403 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9a6e7f76-6d8c-4ff8-ac10-bbab396ae247 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:49.049557 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9a6e7f76-6d8c-4ff8-ac10-bbab396ae247 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1731 microversion: 2.20 time: 0.175607 Jan 10 11:43:49.050111 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 470/934] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:48 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:50.068163 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-d61d1686-b744-4e85-9ff4-e2a9eee3c8db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:50.068772 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-d61d1686-b744-4e85-9ff4-e2a9eee3c8db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:50.075071 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d61d1686-b744-4e85-9ff4-e2a9eee3c8db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:50.076220 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d61d1686-b744-4e85-9ff4-e2a9eee3c8db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:50.077208 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d61d1686-b744-4e85-9ff4-e2a9eee3c8db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:50.077652 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d61d1686-b744-4e85-9ff4-e2a9eee3c8db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:50.203947 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-d61d1686-b744-4e85-9ff4-e2a9eee3c8db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:50.211671 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-d61d1686-b744-4e85-9ff4-e2a9eee3c8db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:50.213197 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-d61d1686-b744-4e85-9ff4-e2a9eee3c8db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:43:50.214368 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-d61d1686-b744-4e85-9ff4-e2a9eee3c8db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1718 microversion: 2.20 time: 0.149975 Jan 10 11:43:50.214928 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 465/935] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:43:50 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:43:53.985078 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a7f598f7-b1ea-471c-b328-f357d2ada9c5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:53.986052 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a7f598f7-b1ea-471c-b328-f357d2ada9c5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:53.992595 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a7f598f7-b1ea-471c-b328-f357d2ada9c5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:53.993058 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a7f598f7-b1ea-471c-b328-f357d2ada9c5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:53.994095 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a7f598f7-b1ea-471c-b328-f357d2ada9c5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:53.994567 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a7f598f7-b1ea-471c-b328-f357d2ada9c5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:54.024490 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a7f598f7-b1ea-471c-b328-f357d2ada9c5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043825 Jan 10 11:43:54.025046 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 471/936] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:43:53 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:43:54.253289 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-db4ce589-305f-4b31-b6e9-5e9c33e1e6be tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:54.253839 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-db4ce589-305f-4b31-b6e9-5e9c33e1e6be tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:54.260130 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-db4ce589-305f-4b31-b6e9-5e9c33e1e6be tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:54.260581 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-db4ce589-305f-4b31-b6e9-5e9c33e1e6be tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:54.261381 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-db4ce589-305f-4b31-b6e9-5e9c33e1e6be tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:54.261798 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-db4ce589-305f-4b31-b6e9-5e9c33e1e6be tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:54.291227 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-db4ce589-305f-4b31-b6e9-5e9c33e1e6be tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments/95f82848-c005-4101-abe5-258217bf61cb" status: 200 len: 194 microversion: 2.1 time: 0.041822 Jan 10 11:43:54.291812 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 466/937] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Jan 10 11:43:54 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments/95f82848-c005-4101-abe5-258217bf61cb => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:43:54.302179 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-513508c4-1bdf-462a-9483-b3664808c450 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:43:54.313104 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-513508c4-1bdf-462a-9483-b3664808c450 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:43:54.313104 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-513508c4-1bdf-462a-9483-b3664808c450 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:54.313104 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-513508c4-1bdf-462a-9483-b3664808c450 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:54.313104 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-513508c4-1bdf-462a-9483-b3664808c450 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:43:54.313485 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-513508c4-1bdf-462a-9483-b3664808c450 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:43:54.391237 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-513508c4-1bdf-462a-9483-b3664808c450 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lazy-loading 'services' on Instance uuid b68f610f-6b78-43a7-93b9-398074034ffe {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:43:54.883850 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-513508c4-1bdf-462a-9483-b3664808c450 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments/95f82848-c005-4101-abe5-258217bf61cb" status: 202 len: 0 microversion: 2.1 time: 0.585117 Jan 10 11:43:54.884459 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 472/938] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jan 10 11:43:54 2022] DELETE /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments/95f82848-c005-4101-abe5-258217bf61cb => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:44:01.476178 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3630fce9-489b-4e15-ac49-9a65eab8411a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:01.476796 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3630fce9-489b-4e15-ac49-9a65eab8411a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:01.482836 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3630fce9-489b-4e15-ac49-9a65eab8411a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:01.483285 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3630fce9-489b-4e15-ac49-9a65eab8411a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:01.484063 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3630fce9-489b-4e15-ac49-9a65eab8411a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:01.484733 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3630fce9-489b-4e15-ac49-9a65eab8411a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:01.617122 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3630fce9-489b-4e15-ac49-9a65eab8411a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:01.625221 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3630fce9-489b-4e15-ac49-9a65eab8411a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1595 microversion: 2.1 time: 0.152815 Jan 10 11:44:01.625789 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 467/939] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:01 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1595 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:02.316210 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-436f1f06-2b7b-4a27-962e-a38d3eb58c91 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:02.317599 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-436f1f06-2b7b-4a27-962e-a38d3eb58c91 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:02.324110 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-436f1f06-2b7b-4a27-962e-a38d3eb58c91 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:02.324654 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-436f1f06-2b7b-4a27-962e-a38d3eb58c91 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:02.325509 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-436f1f06-2b7b-4a27-962e-a38d3eb58c91 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:02.326045 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-436f1f06-2b7b-4a27-962e-a38d3eb58c91 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:02.357604 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-436f1f06-2b7b-4a27-962e-a38d3eb58c91 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments/ee047682-a0cf-45f8-bc0e-e0efc4000c1c" status: 200 len: 194 microversion: 2.1 time: 0.047855 Jan 10 11:44:02.358186 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 473/940] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Jan 10 11:44:02 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments/ee047682-a0cf-45f8-bc0e-e0efc4000c1c => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:02.367972 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7eb053e4-0989-4253-8e3d-7c736c342fe3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:02.368931 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7eb053e4-0989-4253-8e3d-7c736c342fe3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:02.375719 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7eb053e4-0989-4253-8e3d-7c736c342fe3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:02.376165 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7eb053e4-0989-4253-8e3d-7c736c342fe3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:02.376957 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7eb053e4-0989-4253-8e3d-7c736c342fe3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:02.377416 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7eb053e4-0989-4253-8e3d-7c736c342fe3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:02.458021 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.objects.instance [None req-7eb053e4-0989-4253-8e3d-7c736c342fe3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lazy-loading 'services' on Instance uuid b68f610f-6b78-43a7-93b9-398074034ffe {{(pid=128718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:44:02.658574 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7eb053e4-0989-4253-8e3d-7c736c342fe3 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments/ee047682-a0cf-45f8-bc0e-e0efc4000c1c" status: 202 len: 0 microversion: 2.1 time: 0.294236 Jan 10 11:44:02.659286 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 468/941] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jan 10 11:44:02 2022] DELETE /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments/ee047682-a0cf-45f8-bc0e-e0efc4000c1c => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:44:03.820838 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-324b5176-fda5-4a92-b381-7dbbe3bd0900 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:03.820838 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-324b5176-fda5-4a92-b381-7dbbe3bd0900 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:03.836894 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-324b5176-fda5-4a92-b381-7dbbe3bd0900 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:03.837352 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-324b5176-fda5-4a92-b381-7dbbe3bd0900 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:03.838162 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-324b5176-fda5-4a92-b381-7dbbe3bd0900 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:03.838633 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-324b5176-fda5-4a92-b381-7dbbe3bd0900 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:03.869594 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-324b5176-fda5-4a92-b381-7dbbe3bd0900 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054183 Jan 10 11:44:03.870304 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 474/942] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:44:03 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:44:03.994054 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-bcd22b75-7d95-49c7-b523-29aaa2d2596a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:03.995168 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-bcd22b75-7d95-49c7-b523-29aaa2d2596a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:04.002695 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bcd22b75-7d95-49c7-b523-29aaa2d2596a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:04.003200 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bcd22b75-7d95-49c7-b523-29aaa2d2596a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:04.004201 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bcd22b75-7d95-49c7-b523-29aaa2d2596a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:04.004637 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-bcd22b75-7d95-49c7-b523-29aaa2d2596a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:04.017505 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-1f3346d4-bf41-4323-89fa-08f6f0ff1322 req-8a6f87bb-498c-4cfd-a424-d539f53196b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec5d091-4d75-4338-b116-9d3966808486", "tag": "ded3fe31-2cd9-4cc2-84d1-829b49e7753f"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:44:04.019568 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:44:04.019568 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:44:04.029100 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-1f3346d4-bf41-4323-89fa-08f6f0ff1322 req-8a6f87bb-498c-4cfd-a424-d539f53196b5 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:04.029768 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-1f3346d4-bf41-4323-89fa-08f6f0ff1322 req-8a6f87bb-498c-4cfd-a424-d539f53196b5 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:04.036814 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-bcd22b75-7d95-49c7-b523-29aaa2d2596a tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047027 Jan 10 11:44:04.037380 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 475/943] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:44:03 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 10 11:44:04.043843 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-1f3346d4-bf41-4323-89fa-08f6f0ff1322 req-8a6f87bb-498c-4cfd-a424-d539f53196b5 service nova] Creating event network-changed:ded3fe31-2cd9-4cc2-84d1-829b49e7753f for instance 6ec5d091-4d75-4338-b116-9d3966808486 on hv-cinder-maste Jan 10 11:44:04.049977 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-1f3346d4-bf41-4323-89fa-08f6f0ff1322 req-8a6f87bb-498c-4cfd-a424-d539f53196b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115608 Jan 10 11:44:04.054007 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 469/944] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:04.101549 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-dd34db6c-c900-4131-b335-6cfaedad99ce tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:04.102053 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-dd34db6c-c900-4131-b335-6cfaedad99ce tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:04.108109 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-dd34db6c-c900-4131-b335-6cfaedad99ce tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:04.108563 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-dd34db6c-c900-4131-b335-6cfaedad99ce tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:04.109501 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-dd34db6c-c900-4131-b335-6cfaedad99ce tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:04.110151 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-dd34db6c-c900-4131-b335-6cfaedad99ce tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:04.137579 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-dd34db6c-c900-4131-b335-6cfaedad99ce tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Going to try to terminate instance {{(pid=128719) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:44:04.470133 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-dd34db6c-c900-4131-b335-6cfaedad99ce tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 204 len: 0 microversion: 2.1 time: 0.372295 Jan 10 11:44:04.471206 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 476/945] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:44:04 2022] DELETE /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:44:04.479780 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4b53e086-ace4-491e-9044-bbecc233cbd5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:04.486805 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4b53e086-ace4-491e-9044-bbecc233cbd5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:04.492150 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4b53e086-ace4-491e-9044-bbecc233cbd5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:04.492609 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4b53e086-ace4-491e-9044-bbecc233cbd5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:04.493407 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4b53e086-ace4-491e-9044-bbecc233cbd5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:04.494345 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4b53e086-ace4-491e-9044-bbecc233cbd5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:04.637005 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4b53e086-ace4-491e-9044-bbecc233cbd5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:04.645735 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4b53e086-ace4-491e-9044-bbecc233cbd5 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 200 len: 1673 microversion: 2.1 time: 0.169891 Jan 10 11:44:04.647098 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 470/946] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:04 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:05.665188 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ab90a496-aaae-4be3-8df9-cbe096e30740 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:05.665879 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ab90a496-aaae-4be3-8df9-cbe096e30740 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:05.673066 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ab90a496-aaae-4be3-8df9-cbe096e30740 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:05.673537 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ab90a496-aaae-4be3-8df9-cbe096e30740 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:05.674359 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ab90a496-aaae-4be3-8df9-cbe096e30740 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:05.674795 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ab90a496-aaae-4be3-8df9-cbe096e30740 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:05.819422 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-ab90a496-aaae-4be3-8df9-cbe096e30740 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:05.827408 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ab90a496-aaae-4be3-8df9-cbe096e30740 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 200 len: 1673 microversion: 2.1 time: 0.166305 Jan 10 11:44:05.827979 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 477/947] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:05 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:06.845621 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ae33be4d-7ab4-423b-8094-14fedf4cad26 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:06.846246 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ae33be4d-7ab4-423b-8094-14fedf4cad26 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:06.852816 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ae33be4d-7ab4-423b-8094-14fedf4cad26 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:06.853266 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ae33be4d-7ab4-423b-8094-14fedf4cad26 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:06.854040 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ae33be4d-7ab4-423b-8094-14fedf4cad26 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:06.854510 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ae33be4d-7ab4-423b-8094-14fedf4cad26 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:06.989249 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ae33be4d-7ab4-423b-8094-14fedf4cad26 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:06.996927 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ae33be4d-7ab4-423b-8094-14fedf4cad26 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 200 len: 1673 microversion: 2.1 time: 0.155136 Jan 10 11:44:06.997503 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 471/948] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:06 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:07.838567 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-5ace96be-c4f1-4c7a-91b8-43ac920e7f3b req-f0030e9f-0073-4e55-a9bb-69cf247d9d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b68f610f-6b78-43a7-93b9-398074034ffe", "name": "network-vif-deleted", "tag": "2c489974-fd34-47ea-ba59-02a172d3541e"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:44:07.840157 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:44:07.840157 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:44:07.848564 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-5ace96be-c4f1-4c7a-91b8-43ac920e7f3b req-f0030e9f-0073-4e55-a9bb-69cf247d9d23 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:07.849015 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-5ace96be-c4f1-4c7a-91b8-43ac920e7f3b req-f0030e9f-0073-4e55-a9bb-69cf247d9d23 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:07.863155 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-1de0e84b-f1df-4cf0-961c-b83fc6911258 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2018524584"}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:44:07.863698 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-1de0e84b-f1df-4cf0-961c-b83fc6911258 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:07.869846 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-5ace96be-c4f1-4c7a-91b8-43ac920e7f3b req-f0030e9f-0073-4e55-a9bb-69cf247d9d23 service nova] Creating event network-vif-deleted:2c489974-fd34-47ea-ba59-02a172d3541e for instance b68f610f-6b78-43a7-93b9-398074034ffe on hv-cinder-maste Jan 10 11:44:07.876411 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-5ace96be-c4f1-4c7a-91b8-43ac920e7f3b req-f0030e9f-0073-4e55-a9bb-69cf247d9d23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040804 Jan 10 11:44:07.877024 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1de0e84b-f1df-4cf0-961c-b83fc6911258 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:07.877855 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1de0e84b-f1df-4cf0-961c-b83fc6911258 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:07.878690 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1de0e84b-f1df-4cf0-961c-b83fc6911258 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:07.879219 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 478/949] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:07.879453 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1de0e84b-f1df-4cf0-961c-b83fc6911258 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:08.016838 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-43bb5a3f-8fef-43ae-ad36-3c0648953f45 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:08.019885 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-43bb5a3f-8fef-43ae-ad36-3c0648953f45 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:08.028026 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-43bb5a3f-8fef-43ae-ad36-3c0648953f45 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:08.028845 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-43bb5a3f-8fef-43ae-ad36-3c0648953f45 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:08.030152 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-43bb5a3f-8fef-43ae-ad36-3c0648953f45 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:08.032147 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-43bb5a3f-8fef-43ae-ad36-3c0648953f45 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:08.033990 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.network.security_group_api [None req-1de0e84b-f1df-4cf0-961c-b83fc6911258 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Adding security group 91656478-ca00-4552-9430-618b46a6b6e2 to port ded3fe31-2cd9-4cc2-84d1-829b49e7753f Jan 10 11:44:08.112491 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-43bb5a3f-8fef-43ae-ad36-3c0648953f45 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ea138daa84701bbf756e1ec43fb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8635cce808f4b1c9e754fe407a2f60b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:08.121773 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-43bb5a3f-8fef-43ae-ad36-3c0648953f45 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 200 len: 1322 microversion: 2.1 time: 0.111025 Jan 10 11:44:08.122836 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 479/950] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:08 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 1322 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:44:08.551337 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-1de0e84b-f1df-4cf0-961c-b83fc6911258 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "POST /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/action" status: 202 len: 0 microversion: 2.1 time: 0.691821 Jan 10 11:44:08.559744 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 472/951] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:44:07 2022] POST /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/action => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:44:08.562526 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-1d38acb4-5122-43b1-9f14-7da9ba25e034 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:08.563410 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-1d38acb4-5122-43b1-9f14-7da9ba25e034 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:08.568639 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-24b1a1b5-2ca2-4f17-a816-9dda27704c29 req-2bc4c3b8-0363-4284-a88b-09d93922200e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec5d091-4d75-4338-b116-9d3966808486", "tag": "ded3fe31-2cd9-4cc2-84d1-829b49e7753f"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:44:08.570244 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:44:08.570244 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:44:08.572989 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1d38acb4-5122-43b1-9f14-7da9ba25e034 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:08.573892 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1d38acb4-5122-43b1-9f14-7da9ba25e034 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:08.575011 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1d38acb4-5122-43b1-9f14-7da9ba25e034 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:08.575683 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1d38acb4-5122-43b1-9f14-7da9ba25e034 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:08.589558 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-24b1a1b5-2ca2-4f17-a816-9dda27704c29 req-2bc4c3b8-0363-4284-a88b-09d93922200e service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:08.589558 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-24b1a1b5-2ca2-4f17-a816-9dda27704c29 req-2bc4c3b8-0363-4284-a88b-09d93922200e service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:08.605173 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-24b1a1b5-2ca2-4f17-a816-9dda27704c29 req-2bc4c3b8-0363-4284-a88b-09d93922200e service nova] Creating event network-changed:ded3fe31-2cd9-4cc2-84d1-829b49e7753f for instance 6ec5d091-4d75-4338-b116-9d3966808486 on hv-cinder-maste Jan 10 11:44:08.612329 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-24b1a1b5-2ca2-4f17-a816-9dda27704c29 req-2bc4c3b8-0363-4284-a88b-09d93922200e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049041 Jan 10 11:44:08.612954 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 473/952] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:08.812497 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-1d38acb4-5122-43b1-9f14-7da9ba25e034 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:08.822442 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-1d38acb4-5122-43b1-9f14-7da9ba25e034 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1761 microversion: 2.1 time: 0.265758 Jan 10 11:44:08.827490 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 480/953] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:08 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1761 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:09.144117 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-dce00ee7-8af8-41d0-af38-344f6783c209 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:09.145489 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-dce00ee7-8af8-41d0-af38-344f6783c209 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:09.156999 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dce00ee7-8af8-41d0-af38-344f6783c209 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:09.157879 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dce00ee7-8af8-41d0-af38-344f6783c209 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:09.159068 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dce00ee7-8af8-41d0-af38-344f6783c209 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:09.159661 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dce00ee7-8af8-41d0-af38-344f6783c209 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:09.180425 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-dce00ee7-8af8-41d0-af38-344f6783c209 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] HTTP exception thrown: Instance b68f610f-6b78-43a7-93b9-398074034ffe could not be found. Jan 10 11:44:09.181259 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-dce00ee7-8af8-41d0-af38-344f6783c209 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Returning 404 to user: Instance b68f610f-6b78-43a7-93b9-398074034ffe could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:44:09.182295 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-dce00ee7-8af8-41d0-af38-344f6783c209 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 404 len: 111 microversion: 2.1 time: 0.045470 Jan 10 11:44:09.186505 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 474/954] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:09 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 10 11:44:09.191377 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-74c88b58-3883-47b8-a3f9-0607a16c4e5d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '.version_select at 0x7f477a296ca0>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:09.386351 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-74c88b58-3883-47b8-a3f9-0607a16c4e5d tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-424959693" status: 202 len: 0 microversion: 2.1 time: 0.198461 Jan 10 11:44:09.387435 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 481/955] 10.222.0.20 () {58 vars in 1217 bytes} [Mon Jan 10 11:44:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-424959693 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:44:12.760802 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8a239e9b-d534-46d7-9909-ead771730eeb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:12.761336 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-8a239e9b-d534-46d7-9909-ead771730eeb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:12.767794 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8a239e9b-d534-46d7-9909-ead771730eeb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:12.768242 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8a239e9b-d534-46d7-9909-ead771730eeb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:12.769033 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8a239e9b-d534-46d7-9909-ead771730eeb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:12.769470 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8a239e9b-d534-46d7-9909-ead771730eeb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:12.783324 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-8a239e9b-d534-46d7-9909-ead771730eeb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] HTTP exception thrown: Instance b68f610f-6b78-43a7-93b9-398074034ffe could not be found. Jan 10 11:44:12.783915 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8a239e9b-d534-46d7-9909-ead771730eeb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Returning 404 to user: Instance b68f610f-6b78-43a7-93b9-398074034ffe could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:44:12.784740 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-8a239e9b-d534-46d7-9909-ead771730eeb tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 404 len: 111 microversion: 2.1 time: 0.027843 Jan 10 11:44:12.785280 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 475/956] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:44:12 2022] DELETE /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:44:12.793626 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5c2c7bb3-e12e-4801-895a-c44e3fc5187c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:12.794262 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5c2c7bb3-e12e-4801-895a-c44e3fc5187c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: b68f610f-6b78-43a7-93b9-398074034ffe] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:12.803563 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5c2c7bb3-e12e-4801-895a-c44e3fc5187c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:12.804012 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5c2c7bb3-e12e-4801-895a-c44e3fc5187c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:12.804787 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5c2c7bb3-e12e-4801-895a-c44e3fc5187c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:12.805219 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5c2c7bb3-e12e-4801-895a-c44e3fc5187c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:12.818974 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-5c2c7bb3-e12e-4801-895a-c44e3fc5187c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] HTTP exception thrown: Instance b68f610f-6b78-43a7-93b9-398074034ffe could not be found. Jan 10 11:44:12.819572 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5c2c7bb3-e12e-4801-895a-c44e3fc5187c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Returning 404 to user: Instance b68f610f-6b78-43a7-93b9-398074034ffe could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:44:12.820417 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5c2c7bb3-e12e-4801-895a-c44e3fc5187c tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe" status: 404 len: 111 microversion: 2.1 time: 0.031031 Jan 10 11:44:12.820959 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 482/957] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:12 2022] GET /compute/v2.1/servers/b68f610f-6b78-43a7-93b9-398074034ffe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:44:14.160782 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-55eacc39-086d-41ad-87b4-d154665f8e5b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:14.161329 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-55eacc39-086d-41ad-87b4-d154665f8e5b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:14.167616 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-55eacc39-086d-41ad-87b4-d154665f8e5b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:14.168065 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-55eacc39-086d-41ad-87b4-d154665f8e5b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:14.168850 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-55eacc39-086d-41ad-87b4-d154665f8e5b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:14.169288 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-55eacc39-086d-41ad-87b4-d154665f8e5b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:14.182492 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-55eacc39-086d-41ad-87b4-d154665f8e5b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] HTTP exception thrown: Instance de742531-93dd-4422-b11c-57c35a136f6e could not be found. Jan 10 11:44:14.183095 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-55eacc39-086d-41ad-87b4-d154665f8e5b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Returning 404 to user: Instance de742531-93dd-4422-b11c-57c35a136f6e could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:44:14.183932 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-55eacc39-086d-41ad-87b4-d154665f8e5b tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "DELETE /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 404 len: 111 microversion: 2.1 time: 0.026961 Jan 10 11:44:14.184511 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 476/958] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:44:14 2022] DELETE /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:44:14.192602 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ebede572-475c-49b5-9bd0-300ba6a985a7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:14.193234 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-ebede572-475c-49b5-9bd0-300ba6a985a7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] [instance: de742531-93dd-4422-b11c-57c35a136f6e] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:14.199803 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ebede572-475c-49b5-9bd0-300ba6a985a7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:14.200252 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ebede572-475c-49b5-9bd0-300ba6a985a7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:14.201567 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ebede572-475c-49b5-9bd0-300ba6a985a7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:14.202112 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-ebede572-475c-49b5-9bd0-300ba6a985a7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:14.214900 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-ebede572-475c-49b5-9bd0-300ba6a985a7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] HTTP exception thrown: Instance de742531-93dd-4422-b11c-57c35a136f6e could not be found. Jan 10 11:44:14.220583 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ebede572-475c-49b5-9bd0-300ba6a985a7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] Returning 404 to user: Instance de742531-93dd-4422-b11c-57c35a136f6e could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:44:14.220583 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ebede572-475c-49b5-9bd0-300ba6a985a7 tempest-AttachVolumeTestJSON-801253792 tempest-AttachVolumeTestJSON-801253792-project] 10.222.0.20 "GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e" status: 404 len: 111 microversion: 2.1 time: 0.027451 Jan 10 11:44:14.220583 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 483/959] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:14 2022] GET /compute/v2.1/servers/de742531-93dd-4422-b11c-57c35a136f6e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:44:21.662331 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-52500501-dec6-4fe1-87bb-64f2b229f2b0 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:44:21.663503 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-52500501-dec6-4fe1-87bb-64f2b229f2b0 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:21.670119 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-52500501-dec6-4fe1-87bb-64f2b229f2b0 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:21.670946 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-52500501-dec6-4fe1-87bb-64f2b229f2b0 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:21.671564 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-52500501-dec6-4fe1-87bb-64f2b229f2b0 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:21.672019 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-52500501-dec6-4fe1-87bb-64f2b229f2b0 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:21.939309 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-52500501-dec6-4fe1-87bb-64f2b229f2b0 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "POST /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/action" status: 202 len: 0 microversion: 2.1 time: 0.280511 Jan 10 11:44:21.939954 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 477/960] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:44:21 2022] POST /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:44:21.949188 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-53b8c07e-4f37-4ed9-b74a-2b7cf06ea8e2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:21.949828 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-53b8c07e-4f37-4ed9-b74a-2b7cf06ea8e2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:21.957583 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-53b8c07e-4f37-4ed9-b74a-2b7cf06ea8e2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:21.958040 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-53b8c07e-4f37-4ed9-b74a-2b7cf06ea8e2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:21.958876 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-53b8c07e-4f37-4ed9-b74a-2b7cf06ea8e2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:21.959327 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-53b8c07e-4f37-4ed9-b74a-2b7cf06ea8e2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:22.109567 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-53b8c07e-4f37-4ed9-b74a-2b7cf06ea8e2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:22.117594 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-53b8c07e-4f37-4ed9-b74a-2b7cf06ea8e2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1753 microversion: 2.1 time: 0.173245 Jan 10 11:44:22.118251 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 484/961] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:21 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:23.142168 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-11a5f34a-ed87-4c0b-858f-5ce8d48e940b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:23.142839 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-11a5f34a-ed87-4c0b-858f-5ce8d48e940b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:23.149295 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-11a5f34a-ed87-4c0b-858f-5ce8d48e940b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:23.149745 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-11a5f34a-ed87-4c0b-858f-5ce8d48e940b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:23.150562 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-11a5f34a-ed87-4c0b-858f-5ce8d48e940b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:23.151000 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-11a5f34a-ed87-4c0b-858f-5ce8d48e940b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:23.266691 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2dc2b731-e104-4048-a8bd-f53c4befb034 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:23.267601 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2dc2b731-e104-4048-a8bd-f53c4befb034 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:23.274019 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2dc2b731-e104-4048-a8bd-f53c4befb034 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:23.274505 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2dc2b731-e104-4048-a8bd-f53c4befb034 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:23.275304 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2dc2b731-e104-4048-a8bd-f53c4befb034 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:23.275737 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2dc2b731-e104-4048-a8bd-f53c4befb034 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:23.307022 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2dc2b731-e104-4048-a8bd-f53c4befb034 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044128 Jan 10 11:44:23.308057 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 485/962] 10.222.0.20 () {60 vars in 1342 bytes} [Mon Jan 10 11:44:23 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:44:23.309954 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-11a5f34a-ed87-4c0b-858f-5ce8d48e940b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:23.322708 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-11a5f34a-ed87-4c0b-858f-5ce8d48e940b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1758 microversion: 2.1 time: 0.185119 Jan 10 11:44:23.324746 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 478/963] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:23 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:23.367040 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-c542ab90-f547-4e6a-adc9-475196349aea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:23.367040 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-c542ab90-f547-4e6a-adc9-475196349aea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:23.372972 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c542ab90-f547-4e6a-adc9-475196349aea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:23.374324 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c542ab90-f547-4e6a-adc9-475196349aea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:23.375128 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c542ab90-f547-4e6a-adc9-475196349aea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:23.375570 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c542ab90-f547-4e6a-adc9-475196349aea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:23.401318 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-c542ab90-f547-4e6a-adc9-475196349aea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Going to try to terminate instance {{(pid=128719) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:44:23.703051 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-c542ab90-f547-4e6a-adc9-475196349aea tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 204 len: 0 microversion: 2.20 time: 0.340723 Jan 10 11:44:23.703578 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 486/964] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Jan 10 11:44:23 2022] DELETE /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 10 11:44:23.711798 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-6b5950a9-c3e2-4c37-adcb-5e3de582be92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:23.712486 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-6b5950a9-c3e2-4c37-adcb-5e3de582be92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:23.719128 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6b5950a9-c3e2-4c37-adcb-5e3de582be92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:23.719629 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6b5950a9-c3e2-4c37-adcb-5e3de582be92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:23.720379 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6b5950a9-c3e2-4c37-adcb-5e3de582be92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:23.720811 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6b5950a9-c3e2-4c37-adcb-5e3de582be92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:23.857293 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-6b5950a9-c3e2-4c37-adcb-5e3de582be92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:23.865967 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-6b5950a9-c3e2-4c37-adcb-5e3de582be92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:23.867526 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-6b5950a9-c3e2-4c37-adcb-5e3de582be92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:23.868689 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-6b5950a9-c3e2-4c37-adcb-5e3de582be92 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1724 microversion: 2.20 time: 0.160588 Jan 10 11:44:23.869268 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 479/965] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:44:23 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:44:24.347167 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9f1e8d72-b028-484c-a781-09595d088292 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:24.347914 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9f1e8d72-b028-484c-a781-09595d088292 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:24.354344 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9f1e8d72-b028-484c-a781-09595d088292 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:24.354804 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9f1e8d72-b028-484c-a781-09595d088292 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:24.355602 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9f1e8d72-b028-484c-a781-09595d088292 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:24.356042 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9f1e8d72-b028-484c-a781-09595d088292 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:24.510282 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9f1e8d72-b028-484c-a781-09595d088292 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:24.519654 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9f1e8d72-b028-484c-a781-09595d088292 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1758 microversion: 2.1 time: 0.177259 Jan 10 11:44:24.520239 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 487/966] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:24 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:24.887702 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-58d1c924-1ec9-4353-b436-60728c64f5db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:24.888310 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-58d1c924-1ec9-4353-b436-60728c64f5db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:24.898003 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-58d1c924-1ec9-4353-b436-60728c64f5db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:24.898498 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-58d1c924-1ec9-4353-b436-60728c64f5db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:24.899333 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-58d1c924-1ec9-4353-b436-60728c64f5db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:24.899777 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-58d1c924-1ec9-4353-b436-60728c64f5db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:25.042027 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-58d1c924-1ec9-4353-b436-60728c64f5db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:25.050531 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-58d1c924-1ec9-4353-b436-60728c64f5db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:25.052065 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-58d1c924-1ec9-4353-b436-60728c64f5db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:25.053216 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-58d1c924-1ec9-4353-b436-60728c64f5db tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1724 microversion: 2.20 time: 0.169384 Jan 10 11:44:25.053794 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 480/967] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:44:24 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:44:25.537007 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3c968cbc-6323-4076-926a-86438e6b1e1f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:25.537724 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-3c968cbc-6323-4076-926a-86438e6b1e1f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:25.544315 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3c968cbc-6323-4076-926a-86438e6b1e1f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:25.544773 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3c968cbc-6323-4076-926a-86438e6b1e1f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:25.546101 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3c968cbc-6323-4076-926a-86438e6b1e1f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:25.546573 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3c968cbc-6323-4076-926a-86438e6b1e1f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:25.692988 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-3c968cbc-6323-4076-926a-86438e6b1e1f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:25.700796 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3c968cbc-6323-4076-926a-86438e6b1e1f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1758 microversion: 2.1 time: 0.167516 Jan 10 11:44:25.702089 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 488/968] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:25 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:26.021116 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-8455e5ff-82b0-4570-af8f-86754789e1e9 req-71fc0d7f-0231-437f-9b69-e535a9319547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70029374-0ab3-49b9-880e-6a102761c463", "name": "network-vif-deleted", "tag": "5d53e751-c135-4aa3-b56f-602088936cc0"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:44:26.022762 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:44:26.022762 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:44:26.030084 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-8455e5ff-82b0-4570-af8f-86754789e1e9 req-71fc0d7f-0231-437f-9b69-e535a9319547 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:26.030728 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-8455e5ff-82b0-4570-af8f-86754789e1e9 req-71fc0d7f-0231-437f-9b69-e535a9319547 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:26.042574 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-8455e5ff-82b0-4570-af8f-86754789e1e9 req-71fc0d7f-0231-437f-9b69-e535a9319547 service nova] Creating event network-vif-deleted:5d53e751-c135-4aa3-b56f-602088936cc0 for instance 70029374-0ab3-49b9-880e-6a102761c463 on hv-cinder-maste Jan 10 11:44:26.048276 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-8455e5ff-82b0-4570-af8f-86754789e1e9 req-71fc0d7f-0231-437f-9b69-e535a9319547 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036603 Jan 10 11:44:26.049118 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 481/969] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:26.071034 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5626fb85-e308-4983-bc08-5063d52ca652 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:26.071655 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5626fb85-e308-4983-bc08-5063d52ca652 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:26.078260 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5626fb85-e308-4983-bc08-5063d52ca652 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:26.079006 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5626fb85-e308-4983-bc08-5063d52ca652 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:26.079827 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5626fb85-e308-4983-bc08-5063d52ca652 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:26.080271 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5626fb85-e308-4983-bc08-5063d52ca652 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:26.144149 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5626fb85-e308-4983-bc08-5063d52ca652 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:26.156926 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5626fb85-e308-4983-bc08-5063d52ca652 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:26.158486 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-5626fb85-e308-4983-bc08-5063d52ca652 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:26.159716 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5626fb85-e308-4983-bc08-5063d52ca652 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1656 microversion: 2.20 time: 0.092551 Jan 10 11:44:26.170351 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 489/970] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:44:26 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1656 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:44:26.719896 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-542bc350-ab4f-4804-845c-bd6a6b83dffe tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:26.720598 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-542bc350-ab4f-4804-845c-bd6a6b83dffe tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:26.726870 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-542bc350-ab4f-4804-845c-bd6a6b83dffe tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:26.727317 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-542bc350-ab4f-4804-845c-bd6a6b83dffe tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:26.728104 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-542bc350-ab4f-4804-845c-bd6a6b83dffe tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:26.728535 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-542bc350-ab4f-4804-845c-bd6a6b83dffe tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:26.886288 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-542bc350-ab4f-4804-845c-bd6a6b83dffe tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:26.894939 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-542bc350-ab4f-4804-845c-bd6a6b83dffe tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1758 microversion: 2.1 time: 0.179469 Jan 10 11:44:26.895443 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 482/971] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:26 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:27.177961 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-0620005a-dd9f-4975-aa58-6f1155d43b62 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:27.178535 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-0620005a-dd9f-4975-aa58-6f1155d43b62 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:27.184895 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0620005a-dd9f-4975-aa58-6f1155d43b62 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:27.185414 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0620005a-dd9f-4975-aa58-6f1155d43b62 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:27.186777 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0620005a-dd9f-4975-aa58-6f1155d43b62 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:27.187229 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-0620005a-dd9f-4975-aa58-6f1155d43b62 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:27.247853 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-0620005a-dd9f-4975-aa58-6f1155d43b62 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:27.257063 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-0620005a-dd9f-4975-aa58-6f1155d43b62 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:27.258576 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-0620005a-dd9f-4975-aa58-6f1155d43b62 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:27.259720 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-0620005a-dd9f-4975-aa58-6f1155d43b62 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1656 microversion: 2.20 time: 0.085637 Jan 10 11:44:27.260306 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 490/972] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:44:27 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1656 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:44:27.912138 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-bd13e6e1-8dd6-4bd1-bb30-824b1c451a6d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:27.919110 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-bd13e6e1-8dd6-4bd1-bb30-824b1c451a6d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:27.919252 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bd13e6e1-8dd6-4bd1-bb30-824b1c451a6d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:27.919667 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bd13e6e1-8dd6-4bd1-bb30-824b1c451a6d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:27.921696 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bd13e6e1-8dd6-4bd1-bb30-824b1c451a6d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:27.922150 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bd13e6e1-8dd6-4bd1-bb30-824b1c451a6d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:28.222361 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-bd13e6e1-8dd6-4bd1-bb30-824b1c451a6d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:28.230239 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-bd13e6e1-8dd6-4bd1-bb30-824b1c451a6d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1758 microversion: 2.1 time: 0.321831 Jan 10 11:44:28.230830 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 483/973] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:27 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1758 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:28.278472 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9742fe63-28a4-4f8f-a7d7-4fea90542d84 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:28.279113 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9742fe63-28a4-4f8f-a7d7-4fea90542d84 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:28.286162 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9742fe63-28a4-4f8f-a7d7-4fea90542d84 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:28.286650 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9742fe63-28a4-4f8f-a7d7-4fea90542d84 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:28.289912 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9742fe63-28a4-4f8f-a7d7-4fea90542d84 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:28.289912 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9742fe63-28a4-4f8f-a7d7-4fea90542d84 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:28.319877 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9742fe63-28a4-4f8f-a7d7-4fea90542d84 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:28.320334 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9742fe63-28a4-4f8f-a7d7-4fea90542d84 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:28.320792 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-9742fe63-28a4-4f8f-a7d7-4fea90542d84 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lazy-loading 'fault' on Instance uuid 70029374-0ab3-49b9-880e-6a102761c463 {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:44:28.366144 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9742fe63-28a4-4f8f-a7d7-4fea90542d84 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:28.375080 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9742fe63-28a4-4f8f-a7d7-4fea90542d84 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:28.376624 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9742fe63-28a4-4f8f-a7d7-4fea90542d84 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2c652557dbd54165a3498c08b2dd5673', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274889e6213c4dfaab0997e2dad420ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:28.377816 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9742fe63-28a4-4f8f-a7d7-4fea90542d84 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 200 len: 1371 microversion: 2.20 time: 0.103168 Jan 10 11:44:28.378575 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 491/974] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:44:28 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 10 11:44:29.248026 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2edf2d48-7592-4df0-a62a-d89509245327 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:29.248877 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2edf2d48-7592-4df0-a62a-d89509245327 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:29.255096 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2edf2d48-7592-4df0-a62a-d89509245327 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:29.255545 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2edf2d48-7592-4df0-a62a-d89509245327 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:29.256423 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2edf2d48-7592-4df0-a62a-d89509245327 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:29.256742 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2edf2d48-7592-4df0-a62a-d89509245327 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:29.396347 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2cd50d0d-6df9-44a5-9e7d-5601289ac711 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:29.396936 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2cd50d0d-6df9-44a5-9e7d-5601289ac711 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:29.403315 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-2edf2d48-7592-4df0-a62a-d89509245327 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:29.403610 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2cd50d0d-6df9-44a5-9e7d-5601289ac711 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:29.404073 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2cd50d0d-6df9-44a5-9e7d-5601289ac711 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:29.405546 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2cd50d0d-6df9-44a5-9e7d-5601289ac711 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:29.405983 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2cd50d0d-6df9-44a5-9e7d-5601289ac711 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:29.412347 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2edf2d48-7592-4df0-a62a-d89509245327 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1758 microversion: 2.1 time: 0.168355 Jan 10 11:44:29.412927 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 484/975] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:29 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:29.419591 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-2cd50d0d-6df9-44a5-9e7d-5601289ac711 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] HTTP exception thrown: Instance 70029374-0ab3-49b9-880e-6a102761c463 could not be found. Jan 10 11:44:29.420191 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2cd50d0d-6df9-44a5-9e7d-5601289ac711 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Returning 404 to user: Instance 70029374-0ab3-49b9-880e-6a102761c463 could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:44:29.421136 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2cd50d0d-6df9-44a5-9e7d-5601289ac711 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 404 len: 111 microversion: 2.20 time: 0.028672 Jan 10 11:44:29.421682 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 492/976] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:44:29 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 10 11:44:29.430018 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-94af2979-0d14-4e85-9b0d-c99e461e9af0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '.version_select at 0x7f4779910f70>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:29.435681 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-5df8a150-76a9-45a3-9571-d0700a5e6835 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:44:29.437862 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-5df8a150-76a9-45a3-9571-d0700a5e6835 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:29.444020 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5df8a150-76a9-45a3-9571-d0700a5e6835 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:29.444450 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5df8a150-76a9-45a3-9571-d0700a5e6835 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:29.445237 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5df8a150-76a9-45a3-9571-d0700a5e6835 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:29.445667 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-5df8a150-76a9-45a3-9571-d0700a5e6835 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:29.504022 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-5df8a150-76a9-45a3-9571-d0700a5e6835 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "POST /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02/action" status: 200 len: 14 microversion: 2.1 time: 0.072821 Jan 10 11:44:29.504678 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 493/977] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:44:29 2022] POST /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 10 11:44:29.555948 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-94af2979-0d14-4e85-9b0d-c99e461e9af0 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1577410726" status: 204 len: 0 microversion: 2.20 time: 0.129803 Jan 10 11:44:29.556541 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 485/978] 10.222.0.20 () {60 vars in 1261 bytes} [Mon Jan 10 11:44:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1577410726 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 10 11:44:30.429144 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-c2ce6673-42a3-4a64-ad79-91a0a5c864f7 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:30.429842 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-c2ce6673-42a3-4a64-ad79-91a0a5c864f7 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:30.440432 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c2ce6673-42a3-4a64-ad79-91a0a5c864f7 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:30.440927 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c2ce6673-42a3-4a64-ad79-91a0a5c864f7 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:30.441699 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c2ce6673-42a3-4a64-ad79-91a0a5c864f7 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:30.442349 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c2ce6673-42a3-4a64-ad79-91a0a5c864f7 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:30.546880 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b8a899a2-51fe-448b-bc84-f9570b8b2388 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:30.547404 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b8a899a2-51fe-448b-bc84-f9570b8b2388 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:30.554692 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b8a899a2-51fe-448b-bc84-f9570b8b2388 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:30.555146 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b8a899a2-51fe-448b-bc84-f9570b8b2388 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:30.556055 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b8a899a2-51fe-448b-bc84-f9570b8b2388 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:30.556696 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b8a899a2-51fe-448b-bc84-f9570b8b2388 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:30.583375 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b8a899a2-51fe-448b-bc84-f9570b8b2388 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Going to try to terminate instance {{(pid=128718) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:44:30.622871 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-c2ce6673-42a3-4a64-ad79-91a0a5c864f7 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:30.631484 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-c2ce6673-42a3-4a64-ad79-91a0a5c864f7 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1758 microversion: 2.1 time: 0.206265 Jan 10 11:44:30.632142 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 494/979] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:30 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1758 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:30.636693 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-6d0f684e-006c-4ee7-9d43-646698c44840 req-d9749d91-28a2-4069-8bc7-33c5e5df8040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d03071b-bd55-49bb-b290-09cd0a05fe02", "tag": "c48c4206-c204-4d5e-bde8-ec64ab3d966d"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:44:30.638436 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:44:30.638436 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:44:30.645965 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-6d0f684e-006c-4ee7-9d43-646698c44840 req-d9749d91-28a2-4069-8bc7-33c5e5df8040 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:30.649362 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-6d0f684e-006c-4ee7-9d43-646698c44840 req-d9749d91-28a2-4069-8bc7-33c5e5df8040 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:30.658323 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-6d0f684e-006c-4ee7-9d43-646698c44840 req-d9749d91-28a2-4069-8bc7-33c5e5df8040 service nova] Creating event network-changed:c48c4206-c204-4d5e-bde8-ec64ab3d966d for instance 3d03071b-bd55-49bb-b290-09cd0a05fe02 on hv-cinder-maste Jan 10 11:44:30.663411 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-6d0f684e-006c-4ee7-9d43-646698c44840 req-d9749d91-28a2-4069-8bc7-33c5e5df8040 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029902 Jan 10 11:44:30.663999 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 495/980] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:30.934553 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b8a899a2-51fe-448b-bc84-f9570b8b2388 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 204 len: 0 microversion: 2.1 time: 0.391330 Jan 10 11:44:30.935146 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 486/981] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:44:30 2022] DELETE /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:44:30.944955 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-9450c63f-0664-4977-9492-c19e6e846e9f tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:30.945751 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-9450c63f-0664-4977-9492-c19e6e846e9f tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:30.953310 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9450c63f-0664-4977-9492-c19e6e846e9f tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:30.953904 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9450c63f-0664-4977-9492-c19e6e846e9f tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:30.954929 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9450c63f-0664-4977-9492-c19e6e846e9f tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:30.955374 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-9450c63f-0664-4977-9492-c19e6e846e9f tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:31.104419 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-9450c63f-0664-4977-9492-c19e6e846e9f tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:31.112897 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-9450c63f-0664-4977-9492-c19e6e846e9f tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1570 microversion: 2.1 time: 0.172498 Jan 10 11:44:31.113476 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 496/982] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:30 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:31.649330 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e2f65cd7-aee4-4fa5-bff0-709b7f5f50dc tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:31.650032 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e2f65cd7-aee4-4fa5-bff0-709b7f5f50dc tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:31.656745 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e2f65cd7-aee4-4fa5-bff0-709b7f5f50dc tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:31.657199 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e2f65cd7-aee4-4fa5-bff0-709b7f5f50dc tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:31.662845 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e2f65cd7-aee4-4fa5-bff0-709b7f5f50dc tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:31.662845 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e2f65cd7-aee4-4fa5-bff0-709b7f5f50dc tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:31.757871 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-72d8dfac-41cd-4646-99dc-9d2882c45b1d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:31.758398 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-72d8dfac-41cd-4646-99dc-9d2882c45b1d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:31.765387 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-72d8dfac-41cd-4646-99dc-9d2882c45b1d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:31.765845 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-72d8dfac-41cd-4646-99dc-9d2882c45b1d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:31.766752 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-72d8dfac-41cd-4646-99dc-9d2882c45b1d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:31.767103 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-72d8dfac-41cd-4646-99dc-9d2882c45b1d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:31.781584 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-72d8dfac-41cd-4646-99dc-9d2882c45b1d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] HTTP exception thrown: Instance 70029374-0ab3-49b9-880e-6a102761c463 could not be found. Jan 10 11:44:31.782234 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-72d8dfac-41cd-4646-99dc-9d2882c45b1d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Returning 404 to user: Instance 70029374-0ab3-49b9-880e-6a102761c463 could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:44:31.783058 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-72d8dfac-41cd-4646-99dc-9d2882c45b1d tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 404 len: 111 microversion: 2.20 time: 0.029086 Jan 10 11:44:31.783609 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 497/983] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Jan 10 11:44:31 2022] DELETE /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 10 11:44:31.791471 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2d5f3973-8f4b-4fe3-9559-2bad54714c7f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:31.792087 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2d5f3973-8f4b-4fe3-9559-2bad54714c7f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: 70029374-0ab3-49b9-880e-6a102761c463] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:31.800036 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2d5f3973-8f4b-4fe3-9559-2bad54714c7f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:31.802314 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2d5f3973-8f4b-4fe3-9559-2bad54714c7f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:31.802314 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2d5f3973-8f4b-4fe3-9559-2bad54714c7f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:31.802644 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2d5f3973-8f4b-4fe3-9559-2bad54714c7f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:31.824756 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-2d5f3973-8f4b-4fe3-9559-2bad54714c7f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] HTTP exception thrown: Instance 70029374-0ab3-49b9-880e-6a102761c463 could not be found. Jan 10 11:44:31.825832 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2d5f3973-8f4b-4fe3-9559-2bad54714c7f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Returning 404 to user: Instance 70029374-0ab3-49b9-880e-6a102761c463 could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:44:31.831179 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2d5f3973-8f4b-4fe3-9559-2bad54714c7f tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463" status: 404 len: 111 microversion: 2.20 time: 0.039470 Jan 10 11:44:31.831179 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 498/984] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:44:31 2022] GET /compute/v2.1/servers/70029374-0ab3-49b9-880e-6a102761c463 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 10 11:44:31.836729 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-e2f65cd7-aee4-4fa5-bff0-709b7f5f50dc tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:31.845855 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e2f65cd7-aee4-4fa5-bff0-709b7f5f50dc tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1758 microversion: 2.1 time: 0.200416 Jan 10 11:44:31.858485 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 487/985] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:31 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1758 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:32.132854 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-864aac98-1264-4cd7-a429-f64f4ab01ede tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:32.133467 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-864aac98-1264-4cd7-a429-f64f4ab01ede tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:32.140731 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-864aac98-1264-4cd7-a429-f64f4ab01ede tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:32.141182 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-864aac98-1264-4cd7-a429-f64f4ab01ede tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:32.141982 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-864aac98-1264-4cd7-a429-f64f4ab01ede tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:32.142442 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-864aac98-1264-4cd7-a429-f64f4ab01ede tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:32.277380 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-864aac98-1264-4cd7-a429-f64f4ab01ede tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:32.286748 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-864aac98-1264-4cd7-a429-f64f4ab01ede tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1451 microversion: 2.1 time: 0.158687 Jan 10 11:44:32.287310 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 499/986] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:32 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:32.866492 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-54b22979-00d9-4797-b2e9-f8ced263a3cb tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:32.867104 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-54b22979-00d9-4797-b2e9-f8ced263a3cb tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:32.873824 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-54b22979-00d9-4797-b2e9-f8ced263a3cb tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:32.874325 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-54b22979-00d9-4797-b2e9-f8ced263a3cb tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:32.875283 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-54b22979-00d9-4797-b2e9-f8ced263a3cb tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:32.875722 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-54b22979-00d9-4797-b2e9-f8ced263a3cb tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:33.048906 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-54b22979-00d9-4797-b2e9-f8ced263a3cb tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:33.052346 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-44fd40a5-617f-4811-a2c4-c1e7a46e2ec5 req-ab18976f-0665-4040-a094-25dd6de98694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d03071b-bd55-49bb-b290-09cd0a05fe02", "name": "network-vif-deleted", "tag": "c48c4206-c204-4d5e-bde8-ec64ab3d966d"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:44:33.054011 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:44:33.054011 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:44:33.059076 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-54b22979-00d9-4797-b2e9-f8ced263a3cb tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1758 microversion: 2.1 time: 0.196698 Jan 10 11:44:33.061521 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 488/987] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:32 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1758 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:33.061803 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-44fd40a5-617f-4811-a2c4-c1e7a46e2ec5 req-ab18976f-0665-4040-a094-25dd6de98694 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:33.062147 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-44fd40a5-617f-4811-a2c4-c1e7a46e2ec5 req-ab18976f-0665-4040-a094-25dd6de98694 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:33.074018 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-44fd40a5-617f-4811-a2c4-c1e7a46e2ec5 req-ab18976f-0665-4040-a094-25dd6de98694 service nova] Creating event network-vif-deleted:c48c4206-c204-4d5e-bde8-ec64ab3d966d for instance 3d03071b-bd55-49bb-b290-09cd0a05fe02 on hv-cinder-maste Jan 10 11:44:33.079645 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-44fd40a5-617f-4811-a2c4-c1e7a46e2ec5 req-ab18976f-0665-4040-a094-25dd6de98694 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030732 Jan 10 11:44:33.080352 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 500/988] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:44:33.165322 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-af1f5c7e-8ffe-4682-b829-76006ac045a5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:33.166266 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-af1f5c7e-8ffe-4682-b829-76006ac045a5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:33.172696 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-af1f5c7e-8ffe-4682-b829-76006ac045a5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:33.173154 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-af1f5c7e-8ffe-4682-b829-76006ac045a5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:33.173953 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-af1f5c7e-8ffe-4682-b829-76006ac045a5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:33.174875 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-af1f5c7e-8ffe-4682-b829-76006ac045a5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:33.190562 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-af1f5c7e-8ffe-4682-b829-76006ac045a5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] HTTP exception thrown: Instance bb58298d-9795-4c2b-86b6-3b17b668765f could not be found. Jan 10 11:44:33.191162 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-af1f5c7e-8ffe-4682-b829-76006ac045a5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Returning 404 to user: Instance bb58298d-9795-4c2b-86b6-3b17b668765f could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:44:33.192143 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-af1f5c7e-8ffe-4682-b829-76006ac045a5 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 404 len: 111 microversion: 2.20 time: 0.030566 Jan 10 11:44:33.192679 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 489/989] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Jan 10 11:44:33 2022] DELETE /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 10 11:44:33.206071 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-1bbec5f2-db87-4f3a-a873-a353c92882d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:33.206807 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-1bbec5f2-db87-4f3a-a873-a353c92882d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] [instance: bb58298d-9795-4c2b-86b6-3b17b668765f] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:33.214984 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1bbec5f2-db87-4f3a-a873-a353c92882d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:33.214984 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1bbec5f2-db87-4f3a-a873-a353c92882d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:33.215437 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1bbec5f2-db87-4f3a-a873-a353c92882d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:33.215878 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1bbec5f2-db87-4f3a-a873-a353c92882d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:33.235624 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-1bbec5f2-db87-4f3a-a873-a353c92882d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] HTTP exception thrown: Instance bb58298d-9795-4c2b-86b6-3b17b668765f could not be found. Jan 10 11:44:33.236227 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-1bbec5f2-db87-4f3a-a873-a353c92882d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] Returning 404 to user: Instance bb58298d-9795-4c2b-86b6-3b17b668765f could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:44:33.237059 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-1bbec5f2-db87-4f3a-a873-a353c92882d4 tempest-AttachVolumeShelveTestJSON-976367417 tempest-AttachVolumeShelveTestJSON-976367417-project] 10.222.0.20 "GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f" status: 404 len: 111 microversion: 2.20 time: 0.040142 Jan 10 11:44:33.242267 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 501/990] 10.222.0.20 () {60 vars in 1276 bytes} [Mon Jan 10 11:44:33 2022] GET /compute/v2.1/servers/bb58298d-9795-4c2b-86b6-3b17b668765f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 10 11:44:33.304290 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-496ca96f-cce1-4284-8d25-a18dd365df03 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:33.304980 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-496ca96f-cce1-4284-8d25-a18dd365df03 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:33.312969 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-496ca96f-cce1-4284-8d25-a18dd365df03 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:33.313431 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-496ca96f-cce1-4284-8d25-a18dd365df03 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:33.314267 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-496ca96f-cce1-4284-8d25-a18dd365df03 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:33.314756 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-496ca96f-cce1-4284-8d25-a18dd365df03 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:33.380330 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-496ca96f-cce1-4284-8d25-a18dd365df03 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:33.388203 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-496ca96f-cce1-4284-8d25-a18dd365df03 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1219 microversion: 2.1 time: 0.088407 Jan 10 11:44:33.388782 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 490/991] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:33 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:34.077219 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b6d94846-bdd4-48eb-a5a6-e2585d291d2d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:34.077844 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b6d94846-bdd4-48eb-a5a6-e2585d291d2d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:34.084366 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b6d94846-bdd4-48eb-a5a6-e2585d291d2d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:34.084822 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b6d94846-bdd4-48eb-a5a6-e2585d291d2d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:34.085657 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b6d94846-bdd4-48eb-a5a6-e2585d291d2d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:34.086075 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b6d94846-bdd4-48eb-a5a6-e2585d291d2d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:34.333867 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-b6d94846-bdd4-48eb-a5a6-e2585d291d2d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:34.342359 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b6d94846-bdd4-48eb-a5a6-e2585d291d2d tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1758 microversion: 2.1 time: 0.269143 Jan 10 11:44:34.343329 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 502/992] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:34 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1758 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:44:34.411075 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e54a5e05-c0c9-4577-ac95-77f32d9600cc tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:34.412205 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e54a5e05-c0c9-4577-ac95-77f32d9600cc tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:34.419985 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e54a5e05-c0c9-4577-ac95-77f32d9600cc tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:34.420596 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e54a5e05-c0c9-4577-ac95-77f32d9600cc tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:34.421335 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e54a5e05-c0c9-4577-ac95-77f32d9600cc tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:34.421769 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e54a5e05-c0c9-4577-ac95-77f32d9600cc tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:34.454057 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e54a5e05-c0c9-4577-ac95-77f32d9600cc tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:34.454534 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e54a5e05-c0c9-4577-ac95-77f32d9600cc tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:34.454983 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.objects.instance [None req-e54a5e05-c0c9-4577-ac95-77f32d9600cc tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lazy-loading 'fault' on Instance uuid 3d03071b-bd55-49bb-b290-09cd0a05fe02 {{(pid=128718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:44:34.499942 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-e54a5e05-c0c9-4577-ac95-77f32d9600cc tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9c367e90704768900cf144a1639c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6940c4980bd247c986a305a72a9d1434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:34.517753 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e54a5e05-c0c9-4577-ac95-77f32d9600cc tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 200 len: 1178 microversion: 2.1 time: 0.111949 Jan 10 11:44:34.519082 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 491/993] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:34 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 1178 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:35.360790 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-46299677-1e79-4214-bd08-b6019fcf2dc2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:35.361393 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-46299677-1e79-4214-bd08-b6019fcf2dc2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:35.369054 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-46299677-1e79-4214-bd08-b6019fcf2dc2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:35.369510 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-46299677-1e79-4214-bd08-b6019fcf2dc2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:35.370631 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-46299677-1e79-4214-bd08-b6019fcf2dc2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:35.371087 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-46299677-1e79-4214-bd08-b6019fcf2dc2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:35.537278 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b9e1b8e8-f95b-4d33-9c96-d1bfcc77e246 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:35.538660 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b9e1b8e8-f95b-4d33-9c96-d1bfcc77e246 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] [instance: 3d03071b-bd55-49bb-b290-09cd0a05fe02] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:35.548513 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b9e1b8e8-f95b-4d33-9c96-d1bfcc77e246 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:35.548963 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b9e1b8e8-f95b-4d33-9c96-d1bfcc77e246 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:35.549761 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b9e1b8e8-f95b-4d33-9c96-d1bfcc77e246 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:35.550197 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b9e1b8e8-f95b-4d33-9c96-d1bfcc77e246 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:35.566120 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-b9e1b8e8-f95b-4d33-9c96-d1bfcc77e246 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] HTTP exception thrown: Instance 3d03071b-bd55-49bb-b290-09cd0a05fe02 could not be found. Jan 10 11:44:35.566778 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b9e1b8e8-f95b-4d33-9c96-d1bfcc77e246 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Returning 404 to user: Instance 3d03071b-bd55-49bb-b290-09cd0a05fe02 could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:44:35.568607 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b9e1b8e8-f95b-4d33-9c96-d1bfcc77e246 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02" status: 404 len: 111 microversion: 2.1 time: 0.035980 Jan 10 11:44:35.573504 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 492/994] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:35 2022] GET /compute/v2.1/servers/3d03071b-bd55-49bb-b290-09cd0a05fe02 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 10 11:44:35.622768 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-46299677-1e79-4214-bd08-b6019fcf2dc2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:35.635898 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-46299677-1e79-4214-bd08-b6019fcf2dc2 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1758 microversion: 2.1 time: 0.279371 Jan 10 11:44:35.636932 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 503/995] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:35 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1758 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:35.956547 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-1cf952ef-0f01-4e0b-b1cf-9c5e99d87351 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] Calling method '.version_select at 0x7f477989ed30>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:36.062258 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-1cf952ef-0f01-4e0b-b1cf-9c5e99d87351 tempest-TestShelveInstance-817577981 tempest-TestShelveInstance-817577981-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-994919792" status: 202 len: 0 microversion: 2.1 time: 0.109420 Jan 10 11:44:36.066569 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 493/996] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jan 10 11:44:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-994919792 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:44:36.655702 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-058fec47-b5eb-4ce3-94e2-78f6d31a1df5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:36.657196 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-058fec47-b5eb-4ce3-94e2-78f6d31a1df5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:36.664937 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-058fec47-b5eb-4ce3-94e2-78f6d31a1df5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:36.665398 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-058fec47-b5eb-4ce3-94e2-78f6d31a1df5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:36.666605 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-058fec47-b5eb-4ce3-94e2-78f6d31a1df5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:36.667085 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-058fec47-b5eb-4ce3-94e2-78f6d31a1df5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:36.935913 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-058fec47-b5eb-4ce3-94e2-78f6d31a1df5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:36.952678 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-058fec47-b5eb-4ce3-94e2-78f6d31a1df5 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1758 microversion: 2.1 time: 0.301050 Jan 10 11:44:36.953718 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 504/997] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:36 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1758 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:37.986967 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-425f3958-37d2-4728-acf5-649c6faa219f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:37.988361 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-425f3958-37d2-4728-acf5-649c6faa219f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:37.998531 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-425f3958-37d2-4728-acf5-649c6faa219f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:38.000037 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-425f3958-37d2-4728-acf5-649c6faa219f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:38.001487 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-425f3958-37d2-4728-acf5-649c6faa219f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:38.002158 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-425f3958-37d2-4728-acf5-649c6faa219f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:38.227066 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-425f3958-37d2-4728-acf5-649c6faa219f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:38.237591 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-425f3958-37d2-4728-acf5-649c6faa219f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1758 microversion: 2.1 time: 0.269704 Jan 10 11:44:38.248664 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 494/998] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:37 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1758 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:39.255118 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3c11332b-1b63-4c3b-9745-953a53598abf tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:39.255761 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-3c11332b-1b63-4c3b-9745-953a53598abf tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:44:39.262111 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3c11332b-1b63-4c3b-9745-953a53598abf tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:39.262600 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3c11332b-1b63-4c3b-9745-953a53598abf tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:39.263393 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3c11332b-1b63-4c3b-9745-953a53598abf tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:44:39.263832 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3c11332b-1b63-4c3b-9745-953a53598abf tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:44:39.707918 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-3c11332b-1b63-4c3b-9745-953a53598abf tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:44:39.716235 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3c11332b-1b63-4c3b-9745-953a53598abf tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1761 microversion: 2.1 time: 0.464747 Jan 10 11:44:39.717558 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 505/999] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:44:39 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1761 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:40.130754 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-99a3624c-27a0-4700-b503-be20cd4432b9 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Action: 'create', calling method: .version_select at 0x7f477989e280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1569012802"}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:44:40.910812 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-99a3624c-27a0-4700-b503-be20cd4432b9 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.924238 Jan 10 11:44:40.911436 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 495/1000] 10.222.0.20 () {60 vars in 1154 bytes} [Mon Jan 10 11:44:39 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 926 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 10 11:44:40.927469 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e2dd86f0-ee58-44df-af1b-3d9757f17195 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f477a1e3280>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:41.006091 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-e2dd86f0-ee58-44df-af1b-3d9757f17195 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3478598c-734a-4ca4-b5d4-4fe00c687c21" status: 200 len: 345 microversion: 2.1 time: 0.086522 Jan 10 11:44:41.006792 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 506/1001] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jan 10 11:44:40 2022] GET /compute/v2.1/os-volumes/3478598c-734a-4ca4-b5d4-4fe00c687c21 => generated 345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:42.022152 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8d9f2de4-c301-4066-bf90-be40235e3c02 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f4779cd9940>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:42.115083 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-8d9f2de4-c301-4066-bf90-be40235e3c02 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3478598c-734a-4ca4-b5d4-4fe00c687c21" status: 200 len: 346 microversion: 2.1 time: 0.097760 Jan 10 11:44:42.115596 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 496/1002] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jan 10 11:44:42 2022] GET /compute/v2.1/os-volumes/3478598c-734a-4ca4-b5d4-4fe00c687c21 => generated 346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:44:42.132213 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-ad285700-bc12-4732-accd-802a5405c51f tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Action: 'create', calling method: .version_select at 0x7f477a2b4700>, body: {"snapshot": {"volume_id": "3478598c-734a-4ca4-b5d4-4fe00c687c21", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1630177105"}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:44:42.650917 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-ad285700-bc12-4732-accd-802a5405c51f tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.523085 Jan 10 11:44:42.651684 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 507/1003] 10.222.0.20 () {60 vars in 1161 bytes} [Mon Jan 10 11:44:42 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:42.661891 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-d821d3d7-fcbc-4041-97f0-551a4f5cf77c tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f4779966e50>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:42.691090 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-d821d3d7-fcbc-4041-97f0-551a4f5cf77c tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b" status: 200 len: 287 microversion: 2.1 time: 0.032445 Jan 10 11:44:42.691338 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 497/1004] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jan 10 11:44:42 2022] GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:42.701580 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-712809ac-f513-4512-90a6-fcb1a0d397e0 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f477a2b4d30>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:42.734566 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-712809ac-f513-4512-90a6-fcb1a0d397e0 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036310 Jan 10 11:44:42.735979 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 508/1005] 10.222.0.20 () {58 vars in 1139 bytes} [Mon Jan 10 11:44:42 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:42.747235 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2bfeee24-1266-4267-a66b-339da065e588 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f477996f1f0>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:42.783960 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2bfeee24-1266-4267-a66b-339da065e588 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b" status: 200 len: 287 microversion: 2.1 time: 0.040642 Jan 10 11:44:42.784558 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 498/1006] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jan 10 11:44:42 2022] GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:43.796697 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e5b6dd07-c185-4e55-8e7d-792767fac0f0 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f477990eaf0>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:43.832999 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-e5b6dd07-c185-4e55-8e7d-792767fac0f0 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b" status: 200 len: 287 microversion: 2.1 time: 0.040003 Jan 10 11:44:43.832999 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 509/1007] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jan 10 11:44:43 2022] GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:44.845244 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-6dd68a1f-85a6-47e8-8bc0-3309de7c68e8 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f47798cf940>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:44.875385 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-6dd68a1f-85a6-47e8-8bc0-3309de7c68e8 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b" status: 200 len: 287 microversion: 2.1 time: 0.034370 Jan 10 11:44:44.875959 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 499/1008] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jan 10 11:44:44 2022] GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:45.887774 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-494d87b4-4250-4222-aba3-068dd9701fd5 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f477a36c700>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:45.921688 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-494d87b4-4250-4222-aba3-068dd9701fd5 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b" status: 200 len: 288 microversion: 2.1 time: 0.035779 Jan 10 11:44:45.921688 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 510/1009] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jan 10 11:44:45 2022] GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:45.931339 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b6aa79b7-03a7-486c-b944-5527aa7a8e08 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f477996fe50>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:46.048101 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b6aa79b7-03a7-486c-b944-5527aa7a8e08 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b" status: 202 len: 0 microversion: 2.1 time: 0.120623 Jan 10 11:44:46.050550 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 500/1010] 10.222.0.20 () {58 vars in 1253 bytes} [Mon Jan 10 11:44:45 2022] DELETE /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:44:46.057189 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-922f3121-172e-4fce-a740-840b7a48baa2 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f477a1f7940>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:46.086793 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-922f3121-172e-4fce-a740-840b7a48baa2 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b" status: 200 len: 287 microversion: 2.1 time: 0.033145 Jan 10 11:44:46.087782 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 511/1011] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jan 10 11:44:46 2022] GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:44:47.099909 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f7450e10-f25c-4660-a660-d5e1ead4e468 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f4779966e50>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:47.128647 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f7450e10-f25c-4660-a660-d5e1ead4e468 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b" status: 200 len: 287 microversion: 2.1 time: 0.032900 Jan 10 11:44:47.129205 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 501/1012] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jan 10 11:44:47 2022] GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:48.140576 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3c8c0704-82b8-4b4b-a08c-ada2bf4e9e3c tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f477a190550>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:48.169506 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3c8c0704-82b8-4b4b-a08c-ada2bf4e9e3c tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b" status: 200 len: 287 microversion: 2.1 time: 0.032987 Jan 10 11:44:48.170148 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 512/1013] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jan 10 11:44:48 2022] GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:49.182386 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-27d7aea2-9474-4de9-8051-20614562835a tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f47799b6dc0>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:49.207179 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-27d7aea2-9474-4de9-8051-20614562835a tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] HTTP exception thrown: Snapshot 06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b could not be found. Jan 10 11:44:49.207814 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-27d7aea2-9474-4de9-8051-20614562835a tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Returning 404 to user: Snapshot 06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:44:49.208661 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-27d7aea2-9474-4de9-8051-20614562835a tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b" status: 404 len: 111 microversion: 2.1 time: 0.030903 Jan 10 11:44:49.209202 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 502/1014] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Jan 10 11:44:49 2022] GET /compute/v2.1/os-snapshots/06f82f9f-3b24-4e5a-99a0-ccb4dbc98e8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:44:49.219623 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7f4ad774-757c-4958-980f-dd222f407f5f tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f477a3f1c10>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:49.466522 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7f4ad774-757c-4958-980f-dd222f407f5f tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/3478598c-734a-4ca4-b5d4-4fe00c687c21" status: 202 len: 0 microversion: 2.1 time: 0.251722 Jan 10 11:44:49.470327 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 513/1015] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jan 10 11:44:49 2022] DELETE /compute/v2.1/os-volumes/3478598c-734a-4ca4-b5d4-4fe00c687c21 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:44:49.476034 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-9ccdc74d-e382-4c26-bde9-775f54395055 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f477996f310>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:49.527483 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-9ccdc74d-e382-4c26-bde9-775f54395055 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3478598c-734a-4ca4-b5d4-4fe00c687c21" status: 200 len: 345 microversion: 2.1 time: 0.055052 Jan 10 11:44:49.529800 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 503/1016] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jan 10 11:44:49 2022] GET /compute/v2.1/os-volumes/3478598c-734a-4ca4-b5d4-4fe00c687c21 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:50.541916 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-09ac655d-284b-4764-9d2b-14a626fa7421 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f477a190dc0>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:50.569906 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-09ac655d-284b-4764-9d2b-14a626fa7421 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] HTTP exception thrown: Volume 3478598c-734a-4ca4-b5d4-4fe00c687c21 could not be found. Jan 10 11:44:50.570708 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-09ac655d-284b-4764-9d2b-14a626fa7421 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Returning 404 to user: Volume 3478598c-734a-4ca4-b5d4-4fe00c687c21 could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:44:50.571699 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-09ac655d-284b-4764-9d2b-14a626fa7421 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3478598c-734a-4ca4-b5d4-4fe00c687c21" status: 404 len: 109 microversion: 2.1 time: 0.034461 Jan 10 11:44:50.572335 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 514/1017] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jan 10 11:44:50 2022] GET /compute/v2.1/os-volumes/3478598c-734a-4ca4-b5d4-4fe00c687c21 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:44:50.583071 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-d0f28df5-adbb-402d-b8d1-7bd5c12e4ed9 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f4779953160>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:50.613057 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-d0f28df5-adbb-402d-b8d1-7bd5c12e4ed9 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] HTTP exception thrown: Volume 3478598c-734a-4ca4-b5d4-4fe00c687c21 could not be found. Jan 10 11:44:50.613993 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-d0f28df5-adbb-402d-b8d1-7bd5c12e4ed9 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Returning 404 to user: Volume 3478598c-734a-4ca4-b5d4-4fe00c687c21 could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:44:50.615131 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-d0f28df5-adbb-402d-b8d1-7bd5c12e4ed9 tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/3478598c-734a-4ca4-b5d4-4fe00c687c21" status: 404 len: 109 microversion: 2.1 time: 0.036052 Jan 10 11:44:50.616153 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 504/1018] 10.222.0.20 () {58 vars in 1247 bytes} [Mon Jan 10 11:44:50 2022] DELETE /compute/v2.1/os-volumes/3478598c-734a-4ca4-b5d4-4fe00c687c21 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:44:50.625640 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-1f516f82-ebed-4560-af29-4e248edd5afe tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Calling method '.version_select at 0x7f477a1ae9d0>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:50.652813 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-1f516f82-ebed-4560-af29-4e248edd5afe tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] HTTP exception thrown: Volume 3478598c-734a-4ca4-b5d4-4fe00c687c21 could not be found. Jan 10 11:44:50.653399 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-1f516f82-ebed-4560-af29-4e248edd5afe tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] Returning 404 to user: Volume 3478598c-734a-4ca4-b5d4-4fe00c687c21 could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:44:50.654305 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-1f516f82-ebed-4560-af29-4e248edd5afe tempest-VolumesSnapshotsTestJSON-1363286968 tempest-VolumesSnapshotsTestJSON-1363286968-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3478598c-734a-4ca4-b5d4-4fe00c687c21" status: 404 len: 109 microversion: 2.1 time: 0.032616 Jan 10 11:44:50.654844 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 515/1019] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jan 10 11:44:50 2022] GET /compute/v2.1/os-volumes/3478598c-734a-4ca4-b5d4-4fe00c687c21 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:44:54.611768 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-5ac0eaa2-da99-4174-b595-2027e5d5d55a tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] Calling method '.version_select at 0x7f4779966dc0>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:54.659127 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-5ac0eaa2-da99-4174-b595-2027e5d5d55a tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/14512146-27a3-4542-94aa-75c7f6260ecd" status: 200 len: 349 microversion: 2.1 time: 0.052655 Jan 10 11:44:54.659696 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 505/1020] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jan 10 11:44:54 2022] GET /compute/v2.1/os-volumes/14512146-27a3-4542-94aa-75c7f6260ecd => generated 349 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:56.430262 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a6285313-b202-4c98-b364-b5323783d2b6 tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] Calling method '.version_select at 0x7f477a1f7700>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:56.477165 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a6285313-b202-4c98-b364-b5323783d2b6 tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5331efb0-b0d4-46ec-9786-2ff265bf819a" status: 200 len: 350 microversion: 2.1 time: 0.050943 Jan 10 11:44:56.477739 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 516/1021] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jan 10 11:44:56 2022] GET /compute/v2.1/os-volumes/5331efb0-b0d4-46ec-9786-2ff265bf819a => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:58.174874 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c9772ae3-f683-4a64-9d1a-66ec3eeaf445 tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] Calling method '.version_select at 0x7f47799b6ee0>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:58.221725 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c9772ae3-f683-4a64-9d1a-66ec3eeaf445 tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/312bdeb1-1574-4b37-8a2e-328976d79a9e" status: 200 len: 350 microversion: 2.1 time: 0.051758 Jan 10 11:44:58.222341 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 506/1022] 10.222.0.20 () {58 vars in 1244 bytes} [Mon Jan 10 11:44:58 2022] GET /compute/v2.1/os-volumes/312bdeb1-1574-4b37-8a2e-328976d79a9e => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:58.234310 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b1369eff-22e5-4a5c-a795-34120ee581c3 tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] Calling method '.version_select at 0x7f477a1e3280>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:58.321115 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b1369eff-22e5-4a5c-a795-34120ee581c3 tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.091525 Jan 10 11:44:58.321768 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 517/1023] 10.222.0.20 () {58 vars in 1133 bytes} [Mon Jan 10 11:44:58 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:58.334002 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0fcc21ae-8d48-4864-a959-b631db10880d tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] Calling method '.version_select at 0x7f4779966670>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:58.412713 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0fcc21ae-8d48-4864-a959-b631db10880d tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.082278 Jan 10 11:44:58.413271 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 507/1024] 10.222.0.20 () {58 vars in 1148 bytes} [Mon Jan 10 11:44:58 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:58.424616 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a29c9cfc-4500-4a72-8780-49472b22867e tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] Calling method '.version_select at 0x7f477990e790>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:58.504708 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a29c9cfc-4500-4a72-8780-49472b22867e tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.083641 Jan 10 11:44:58.505269 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 518/1025] 10.222.0.20 () {58 vars in 1133 bytes} [Mon Jan 10 11:44:58 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:58.516832 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8d6dde6b-f86b-4bc1-821c-a1dd43ca29ce tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] Calling method '.version_select at 0x7f477996f940>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:58.596064 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-8d6dde6b-f86b-4bc1-821c-a1dd43ca29ce tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083460 Jan 10 11:44:58.596617 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 508/1026] 10.222.0.20 () {58 vars in 1166 bytes} [Mon Jan 10 11:44:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:58.607991 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-dd2add43-64b4-4070-8dfa-708261d9af6c tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] Calling method '.version_select at 0x7f477a3f1dc0>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:58.688300 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-dd2add43-64b4-4070-8dfa-708261d9af6c tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.081524 Jan 10 11:44:58.688300 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 519/1027] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Jan 10 11:44:58 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:58.699071 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-eac42f81-c708-4d14-a480-1baae76f10bb tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] Calling method '.version_select at 0x7f477999fe50>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:58.777061 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-eac42f81-c708-4d14-a480-1baae76f10bb tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.081462 Jan 10 11:44:58.777533 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 509/1028] 10.222.0.20 () {58 vars in 1154 bytes} [Mon Jan 10 11:44:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:44:58.788708 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-c9562559-0e91-4469-b818-05e685d48341 tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] Calling method '.version_select at 0x7f477a45e3a0>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:58.868366 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-c9562559-0e91-4469-b818-05e685d48341 tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083217 Jan 10 11:44:58.868934 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 520/1029] 10.222.0.20 () {58 vars in 1187 bytes} [Mon Jan 10 11:44:58 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:44:58.880914 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c0f2e517-827c-465a-af99-b8d73456023e tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] Calling method '.version_select at 0x7f477999fb80>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:44:58.958922 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c0f2e517-827c-465a-af99-b8d73456023e tempest-VolumesTestJSON-1486875887 tempest-VolumesTestJSON-1486875887-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.081560 Jan 10 11:44:58.959506 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 510/1030] 10.222.0.20 () {58 vars in 1154 bytes} [Mon Jan 10 11:44:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:45:15.321010 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-1a27a574-bf56-41d1-bd54-4e45bb7a4746 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2018524584"}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:45:15.321010 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-1a27a574-bf56-41d1-bd54-4e45bb7a4746 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:45:15.325712 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1a27a574-bf56-41d1-bd54-4e45bb7a4746 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:15.326167 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1a27a574-bf56-41d1-bd54-4e45bb7a4746 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:15.326990 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1a27a574-bf56-41d1-bd54-4e45bb7a4746 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:15.327544 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-1a27a574-bf56-41d1-bd54-4e45bb7a4746 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:15.462058 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.network.security_group_api [None req-1a27a574-bf56-41d1-bd54-4e45bb7a4746 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Removing security group 91656478-ca00-4552-9430-618b46a6b6e2 from port ded3fe31-2cd9-4cc2-84d1-829b49e7753f Jan 10 11:45:16.144580 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-1a27a574-bf56-41d1-bd54-4e45bb7a4746 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "POST /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/action" status: 202 len: 0 microversion: 2.1 time: 0.831236 Jan 10 11:45:16.145814 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 521/1031] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Jan 10 11:45:15 2022] POST /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/action => generated 0 bytes in 834 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:45:16.154428 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-cd975935-55bc-419b-b797-3e66de757f7c req-f71a3dc1-89c2-456b-a177-20c52608af57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec5d091-4d75-4338-b116-9d3966808486", "tag": "ded3fe31-2cd9-4cc2-84d1-829b49e7753f"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:45:16.156579 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:45:16.156579 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:45:16.164437 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-cd975935-55bc-419b-b797-3e66de757f7c req-f71a3dc1-89c2-456b-a177-20c52608af57 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:16.164882 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-cd975935-55bc-419b-b797-3e66de757f7c req-f71a3dc1-89c2-456b-a177-20c52608af57 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:16.180036 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-cd975935-55bc-419b-b797-3e66de757f7c req-f71a3dc1-89c2-456b-a177-20c52608af57 service nova] Creating event network-changed:ded3fe31-2cd9-4cc2-84d1-829b49e7753f for instance 6ec5d091-4d75-4338-b116-9d3966808486 on hv-cinder-maste Jan 10 11:45:16.187765 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-cd975935-55bc-419b-b797-3e66de757f7c req-f71a3dc1-89c2-456b-a177-20c52608af57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037181 Jan 10 11:45:16.188717 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 511/1032] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:45:17.417053 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-cd9dd420-bc96-470b-8d5a-4f4e0e456c47 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:45:17.417574 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-cd9dd420-bc96-470b-8d5a-4f4e0e456c47 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:45:17.424204 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cd9dd420-bc96-470b-8d5a-4f4e0e456c47 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:17.424650 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cd9dd420-bc96-470b-8d5a-4f4e0e456c47 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:17.425471 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cd9dd420-bc96-470b-8d5a-4f4e0e456c47 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:17.425904 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-cd9dd420-bc96-470b-8d5a-4f4e0e456c47 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:17.504678 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-cd9dd420-bc96-470b-8d5a-4f4e0e456c47 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lazy-loading 'services' on Instance uuid 6ec5d091-4d75-4338-b116-9d3966808486 {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:45:17.747556 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-cd9dd420-bc96-470b-8d5a-4f4e0e456c47 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/os-volume_attachments/2ff704e7-10fe-4df0-a138-1adb7809a92b" status: 202 len: 0 microversion: 2.1 time: 0.334169 Jan 10 11:45:17.748103 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 522/1033] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jan 10 11:45:17 2022] DELETE /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/os-volume_attachments/2ff704e7-10fe-4df0-a138-1adb7809a92b => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:45:17.757369 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4e2ff63d-1ec7-4dbb-a1ae-b41576896a83 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:45:17.758420 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4e2ff63d-1ec7-4dbb-a1ae-b41576896a83 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:45:17.764707 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4e2ff63d-1ec7-4dbb-a1ae-b41576896a83 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:17.769402 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4e2ff63d-1ec7-4dbb-a1ae-b41576896a83 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:17.769402 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4e2ff63d-1ec7-4dbb-a1ae-b41576896a83 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:17.769402 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4e2ff63d-1ec7-4dbb-a1ae-b41576896a83 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:17.806097 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4e2ff63d-1ec7-4dbb-a1ae-b41576896a83 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053198 Jan 10 11:45:17.806675 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 512/1034] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:45:17 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:45:18.204192 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-c2115501-6277-4ed2-92d5-58d2548a4f08 req-44845d24-0ea9-41da-93f5-51dfff2564a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec5d091-4d75-4338-b116-9d3966808486", "tag": "ded3fe31-2cd9-4cc2-84d1-829b49e7753f"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:45:18.205866 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:45:18.205866 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:45:18.213294 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-c2115501-6277-4ed2-92d5-58d2548a4f08 req-44845d24-0ea9-41da-93f5-51dfff2564a7 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:18.213738 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-c2115501-6277-4ed2-92d5-58d2548a4f08 req-44845d24-0ea9-41da-93f5-51dfff2564a7 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:18.225535 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-c2115501-6277-4ed2-92d5-58d2548a4f08 req-44845d24-0ea9-41da-93f5-51dfff2564a7 service nova] Creating event network-changed:ded3fe31-2cd9-4cc2-84d1-829b49e7753f for instance 6ec5d091-4d75-4338-b116-9d3966808486 on hv-cinder-maste Jan 10 11:45:18.230496 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-c2115501-6277-4ed2-92d5-58d2548a4f08 req-44845d24-0ea9-41da-93f5-51dfff2564a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031125 Jan 10 11:45:18.231104 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 523/1035] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:45:18.817790 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a1e52bcb-de11-47c7-adba-67c30814774b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:45:18.818757 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a1e52bcb-de11-47c7-adba-67c30814774b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:45:18.825755 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a1e52bcb-de11-47c7-adba-67c30814774b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:18.826229 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a1e52bcb-de11-47c7-adba-67c30814774b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:18.827030 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a1e52bcb-de11-47c7-adba-67c30814774b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:18.827490 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a1e52bcb-de11-47c7-adba-67c30814774b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:18.856281 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a1e52bcb-de11-47c7-adba-67c30814774b tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042575 Jan 10 11:45:18.856841 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 513/1036] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:45:18 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:45:19.869736 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3a6e9402-dd6e-46cb-b2a2-244c4863534e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:45:19.870757 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-3a6e9402-dd6e-46cb-b2a2-244c4863534e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:45:19.878229 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3a6e9402-dd6e-46cb-b2a2-244c4863534e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:19.879183 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3a6e9402-dd6e-46cb-b2a2-244c4863534e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:19.879453 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3a6e9402-dd6e-46cb-b2a2-244c4863534e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:19.879885 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3a6e9402-dd6e-46cb-b2a2-244c4863534e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:19.909410 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3a6e9402-dd6e-46cb-b2a2-244c4863534e tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044833 Jan 10 11:45:19.909975 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 524/1037] 10.222.0.20 () {58 vars in 1301 bytes} [Mon Jan 10 11:45:19 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 10 11:45:19.919699 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b3a07d3f-18b7-4312-aeed-42a70f7a5d80 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:45:19.920197 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b3a07d3f-18b7-4312-aeed-42a70f7a5d80 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:45:19.927234 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b3a07d3f-18b7-4312-aeed-42a70f7a5d80 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:19.928350 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b3a07d3f-18b7-4312-aeed-42a70f7a5d80 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:19.929158 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b3a07d3f-18b7-4312-aeed-42a70f7a5d80 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:19.929980 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b3a07d3f-18b7-4312-aeed-42a70f7a5d80 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:20.004409 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-b3a07d3f-18b7-4312-aeed-42a70f7a5d80 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] HTTP exception thrown: Instance 6ec5d091-4d75-4338-b116-9d3966808486 is not attached to volume 2ff704e7-10fe-4df0-a138-1adb7809a92b Jan 10 11:45:20.005012 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b3a07d3f-18b7-4312-aeed-42a70f7a5d80 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Returning 404 to user: Instance 6ec5d091-4d75-4338-b116-9d3966808486 is not attached to volume 2ff704e7-10fe-4df0-a138-1adb7809a92b {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:45:20.005846 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b3a07d3f-18b7-4312-aeed-42a70f7a5d80 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/os-volume_attachments/2ff704e7-10fe-4df0-a138-1adb7809a92b" status: 404 len: 154 microversion: 2.1 time: 0.090214 Jan 10 11:45:20.006430 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 514/1038] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jan 10 11:45:19 2022] DELETE /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486/os-volume_attachments/2ff704e7-10fe-4df0-a138-1adb7809a92b => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:45:21.308489 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-098f170a-9cc1-4dfd-8ab6-61bb8d0fc248 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:45:21.309055 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-098f170a-9cc1-4dfd-8ab6-61bb8d0fc248 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:45:21.315654 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-098f170a-9cc1-4dfd-8ab6-61bb8d0fc248 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:21.316111 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-098f170a-9cc1-4dfd-8ab6-61bb8d0fc248 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:21.316904 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-098f170a-9cc1-4dfd-8ab6-61bb8d0fc248 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:21.317338 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-098f170a-9cc1-4dfd-8ab6-61bb8d0fc248 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:21.342160 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-098f170a-9cc1-4dfd-8ab6-61bb8d0fc248 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Going to try to terminate instance {{(pid=128719) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:45:21.705965 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-098f170a-9cc1-4dfd-8ab6-61bb8d0fc248 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 204 len: 0 microversion: 2.1 time: 0.400785 Jan 10 11:45:21.706600 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 525/1039] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:45:21 2022] DELETE /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:45:21.714655 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-56d03548-515c-4e23-8258-95218f3e943a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:45:21.715279 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-56d03548-515c-4e23-8258-95218f3e943a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:45:21.721649 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-56d03548-515c-4e23-8258-95218f3e943a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:21.722093 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-56d03548-515c-4e23-8258-95218f3e943a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:21.722909 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-56d03548-515c-4e23-8258-95218f3e943a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:21.723342 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-56d03548-515c-4e23-8258-95218f3e943a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:21.859811 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-56d03548-515c-4e23-8258-95218f3e943a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:45:21.867441 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-56d03548-515c-4e23-8258-95218f3e943a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1555 microversion: 2.1 time: 0.156463 Jan 10 11:45:21.867999 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 515/1040] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:45:21 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:45:22.895463 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-efe24a7c-3939-4395-b3a7-c3b23edcf6e4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:45:22.896169 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-efe24a7c-3939-4395-b3a7-c3b23edcf6e4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:45:22.903566 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-efe24a7c-3939-4395-b3a7-c3b23edcf6e4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:22.903566 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-efe24a7c-3939-4395-b3a7-c3b23edcf6e4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:22.903762 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-efe24a7c-3939-4395-b3a7-c3b23edcf6e4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:22.908670 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-efe24a7c-3939-4395-b3a7-c3b23edcf6e4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:23.045637 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-efe24a7c-3939-4395-b3a7-c3b23edcf6e4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:45:23.053142 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-efe24a7c-3939-4395-b3a7-c3b23edcf6e4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1555 microversion: 2.1 time: 0.162297 Jan 10 11:45:23.053769 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 526/1041] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:45:22 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:45:24.070507 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-68234bc2-2fb9-41ae-929e-0de06fa2d68f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:45:24.071127 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-68234bc2-2fb9-41ae-929e-0de06fa2d68f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:45:24.077699 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-68234bc2-2fb9-41ae-929e-0de06fa2d68f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:24.078164 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-68234bc2-2fb9-41ae-929e-0de06fa2d68f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:24.078992 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-68234bc2-2fb9-41ae-929e-0de06fa2d68f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:24.079434 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-68234bc2-2fb9-41ae-929e-0de06fa2d68f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:24.211378 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-68234bc2-2fb9-41ae-929e-0de06fa2d68f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:45:24.219300 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-68234bc2-2fb9-41ae-929e-0de06fa2d68f tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1555 microversion: 2.1 time: 0.151894 Jan 10 11:45:24.219861 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 516/1042] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:45:24 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:45:25.236713 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-785de611-5365-497d-837b-1d4c1182ee33 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:45:25.237321 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-785de611-5365-497d-837b-1d4c1182ee33 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:45:25.243841 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-785de611-5365-497d-837b-1d4c1182ee33 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:25.244288 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-785de611-5365-497d-837b-1d4c1182ee33 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:25.245088 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-785de611-5365-497d-837b-1d4c1182ee33 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:25.245520 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-785de611-5365-497d-837b-1d4c1182ee33 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:25.380368 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-785de611-5365-497d-837b-1d4c1182ee33 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:45:25.387765 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-785de611-5365-497d-837b-1d4c1182ee33 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1555 microversion: 2.1 time: 0.155321 Jan 10 11:45:25.388738 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 527/1043] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:45:25 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:45:26.055103 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-a6d9f725-bc2e-4e37-870b-f3ffa4831508 req-d53e390d-0f9f-46f1-b8c0-37feac047e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec5d091-4d75-4338-b116-9d3966808486", "name": "network-vif-deleted", "tag": "ded3fe31-2cd9-4cc2-84d1-829b49e7753f"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:45:26.056897 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:45:26.056897 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:45:26.064329 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-a6d9f725-bc2e-4e37-870b-f3ffa4831508 req-d53e390d-0f9f-46f1-b8c0-37feac047e0c service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:26.064778 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-a6d9f725-bc2e-4e37-870b-f3ffa4831508 req-d53e390d-0f9f-46f1-b8c0-37feac047e0c service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:26.075934 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-a6d9f725-bc2e-4e37-870b-f3ffa4831508 req-d53e390d-0f9f-46f1-b8c0-37feac047e0c service nova] Creating event network-vif-deleted:ded3fe31-2cd9-4cc2-84d1-829b49e7753f for instance 6ec5d091-4d75-4338-b116-9d3966808486 on hv-cinder-maste Jan 10 11:45:26.081028 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-a6d9f725-bc2e-4e37-870b-f3ffa4831508 req-d53e390d-0f9f-46f1-b8c0-37feac047e0c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029739 Jan 10 11:45:26.081631 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 517/1044] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:45:26.404656 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-3222382d-9684-4e7f-8e3f-14735c4264b6 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:45:26.405290 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-3222382d-9684-4e7f-8e3f-14735c4264b6 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:45:26.412392 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3222382d-9684-4e7f-8e3f-14735c4264b6 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:26.412842 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3222382d-9684-4e7f-8e3f-14735c4264b6 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:26.413644 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3222382d-9684-4e7f-8e3f-14735c4264b6 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:26.414081 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-3222382d-9684-4e7f-8e3f-14735c4264b6 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:26.487052 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-3222382d-9684-4e7f-8e3f-14735c4264b6 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:45:26.500962 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-3222382d-9684-4e7f-8e3f-14735c4264b6 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1343 microversion: 2.1 time: 0.094438 Jan 10 11:45:26.500962 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 528/1045] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:45:26 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1343 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:45:27.514484 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-5e212405-2c85-4b65-9a77-7fb0413d676a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:45:27.515188 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-5e212405-2c85-4b65-9a77-7fb0413d676a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:45:27.521899 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5e212405-2c85-4b65-9a77-7fb0413d676a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:27.522397 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5e212405-2c85-4b65-9a77-7fb0413d676a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:27.523216 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5e212405-2c85-4b65-9a77-7fb0413d676a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:27.523657 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5e212405-2c85-4b65-9a77-7fb0413d676a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:27.554627 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5e212405-2c85-4b65-9a77-7fb0413d676a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:27.555066 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-5e212405-2c85-4b65-9a77-7fb0413d676a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:27.555516 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.objects.instance [None req-5e212405-2c85-4b65-9a77-7fb0413d676a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lazy-loading 'fault' on Instance uuid 6ec5d091-4d75-4338-b116-9d3966808486 {{(pid=128718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:45:27.595295 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-5e212405-2c85-4b65-9a77-7fb0413d676a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:45:27.602617 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-5e212405-2c85-4b65-9a77-7fb0413d676a tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1348 microversion: 2.1 time: 0.092668 Jan 10 11:45:27.603176 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 518/1046] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:45:27 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1348 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:45:28.619661 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2e90a062-2e9f-453a-b7d6-fe9140947166 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:45:28.620279 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2e90a062-2e9f-453a-b7d6-fe9140947166 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:45:28.627797 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e90a062-2e9f-453a-b7d6-fe9140947166 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:28.628240 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e90a062-2e9f-453a-b7d6-fe9140947166 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:28.629015 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e90a062-2e9f-453a-b7d6-fe9140947166 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:28.629447 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e90a062-2e9f-453a-b7d6-fe9140947166 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:28.661975 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e90a062-2e9f-453a-b7d6-fe9140947166 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:28.662453 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e90a062-2e9f-453a-b7d6-fe9140947166 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:28.662895 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-2e90a062-2e9f-453a-b7d6-fe9140947166 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lazy-loading 'fault' on Instance uuid 6ec5d091-4d75-4338-b116-9d3966808486 {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:45:28.701434 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2e90a062-2e9f-453a-b7d6-fe9140947166 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f31a023173496e977e99bbc0eb6b8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c180d632e41cdb97880086d7705c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:45:28.709461 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2e90a062-2e9f-453a-b7d6-fe9140947166 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 200 len: 1348 microversion: 2.1 time: 0.093409 Jan 10 11:45:28.710031 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 529/1047] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:45:28 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 1348 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:45:29.726881 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3c611e88-754a-4b7d-b2d2-8ffe267724c4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:45:29.727488 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3c611e88-754a-4b7d-b2d2-8ffe267724c4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] [instance: 6ec5d091-4d75-4338-b116-9d3966808486] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:45:29.733686 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3c611e88-754a-4b7d-b2d2-8ffe267724c4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:29.734140 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3c611e88-754a-4b7d-b2d2-8ffe267724c4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:29.734956 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3c611e88-754a-4b7d-b2d2-8ffe267724c4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:45:29.735388 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3c611e88-754a-4b7d-b2d2-8ffe267724c4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:45:29.752489 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-3c611e88-754a-4b7d-b2d2-8ffe267724c4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] HTTP exception thrown: Instance 6ec5d091-4d75-4338-b116-9d3966808486 could not be found. Jan 10 11:45:29.752489 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3c611e88-754a-4b7d-b2d2-8ffe267724c4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Returning 404 to user: Instance 6ec5d091-4d75-4338-b116-9d3966808486 could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:45:29.752489 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3c611e88-754a-4b7d-b2d2-8ffe267724c4 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486" status: 404 len: 111 microversion: 2.1 time: 0.027101 Jan 10 11:45:29.752489 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 519/1048] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:45:29 2022] GET /compute/v2.1/servers/6ec5d091-4d75-4338-b116-9d3966808486 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:45:29.759133 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-42f57424-0f39-4e17-a083-230140808d49 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] Calling method '.version_select at 0x7f477a1e3280>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:45:29.873235 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-42f57424-0f39-4e17-a083-230140808d49 tempest-TestMinimumBasicScenario-31123894 tempest-TestMinimumBasicScenario-31123894-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1815420863" status: 202 len: 0 microversion: 2.1 time: 0.117506 Jan 10 11:45:29.873820 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 530/1049] 10.222.0.20 () {58 vars in 1271 bytes} [Mon Jan 10 11:45:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1815420863 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:45:53.165902 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 11:45:53.166871 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: Mon Jan 10 11:45:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 11:46:04.405367 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-090076e6-6876-446f-8329-c6130a019118 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-864663473", "imageRef": "b6e63192-9c33-4d80-9555-6de2bb10fd32", "flavorRef": "452", "networks": [{"uuid": "e5d4369a-3d75-409b-831d-a85be7aee434"}]}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:46:04.459445 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.network.neutron [None req-090076e6-6876-446f-8329-c6130a019118 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] validate_networks() for [('e5d4369a-3d75-409b-831d-a85be7aee434', None, None, None, None, None)] {{(pid=128718) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:46:04.960116 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-090076e6-6876-446f-8329-c6130a019118 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Flavor limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:46:04.960535 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-090076e6-6876-446f-8329-c6130a019118 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Image limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:46:04.961059 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-090076e6-6876-446f-8329-c6130a019118 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Flavor pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:46:04.961462 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-090076e6-6876-446f-8329-c6130a019118 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Image pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:46:04.961867 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-090076e6-6876-446f-8329-c6130a019118 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:46:04.971980 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-090076e6-6876-446f-8329-c6130a019118 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:04.972320 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-090076e6-6876-446f-8329-c6130a019118 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:04.973126 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-090076e6-6876-446f-8329-c6130a019118 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:04.973640 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-090076e6-6876-446f-8329-c6130a019118 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:04.990337 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-090076e6-6876-446f-8329-c6130a019118 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Getting quotas for project 77459867f2ca40c6aac9eebdcfed7ca2. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:46:04.994205 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-090076e6-6876-446f-8329-c6130a019118 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Getting quotas for user 170dcc817fa34bc781ffe7fedf729b88 and project 77459867f2ca40c6aac9eebdcfed7ca2. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:46:05.007105 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-090076e6-6876-446f-8329-c6130a019118 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Going to run 1 instances... {{(pid=128718) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:46:05.009424 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-090076e6-6876-446f-8329-c6130a019118 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e63192-9c33-4d80-9555-6de2bb10fd32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:46:05.132140 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-090076e6-6876-446f-8329-c6130a019118 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731108 Jan 10 11:46:05.133025 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 520/1050] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:46:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 11:46:05.144065 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d7741e1a-11aa-455e-9a59-cd94d247b678 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:46:05.145036 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d7741e1a-11aa-455e-9a59-cd94d247b678 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:46:05.223095 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-d7741e1a-11aa-455e-9a59-cd94d247b678 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:46:05.230632 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d7741e1a-11aa-455e-9a59-cd94d247b678 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 200 len: 1218 microversion: 2.1 time: 0.090377 Jan 10 11:46:05.231408 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 531/1051] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:46:05 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:46:06.248284 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c849fa72-45bc-4ef7-8e3f-25cf60300034 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:46:06.248899 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c849fa72-45bc-4ef7-8e3f-25cf60300034 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:46:06.303626 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c849fa72-45bc-4ef7-8e3f-25cf60300034 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:46:06.312925 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c849fa72-45bc-4ef7-8e3f-25cf60300034 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 200 len: 1218 microversion: 2.1 time: 0.065950 Jan 10 11:46:06.312925 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 521/1052] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:46:06 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:46:07.328022 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-80cd1163-9320-499b-af3f-930a26639e2c tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:46:07.328652 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-80cd1163-9320-499b-af3f-930a26639e2c tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:46:07.335085 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-80cd1163-9320-499b-af3f-930a26639e2c tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:07.335580 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-80cd1163-9320-499b-af3f-930a26639e2c tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:07.336362 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-80cd1163-9320-499b-af3f-930a26639e2c tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:07.336794 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-80cd1163-9320-499b-af3f-930a26639e2c tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:07.402943 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-80cd1163-9320-499b-af3f-930a26639e2c tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:46:07.410992 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-80cd1163-9320-499b-af3f-930a26639e2c tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 200 len: 1270 microversion: 2.1 time: 0.086792 Jan 10 11:46:07.411566 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 532/1053] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:46:07 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:46:08.429480 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0b98e683-bc76-4b04-a578-e1d6b4ed54ea tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:46:08.429999 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0b98e683-bc76-4b04-a578-e1d6b4ed54ea tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:46:08.436623 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0b98e683-bc76-4b04-a578-e1d6b4ed54ea tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:08.437171 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0b98e683-bc76-4b04-a578-e1d6b4ed54ea tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:08.437982 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0b98e683-bc76-4b04-a578-e1d6b4ed54ea tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:08.439053 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0b98e683-bc76-4b04-a578-e1d6b4ed54ea tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:08.579574 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0b98e683-bc76-4b04-a578-e1d6b4ed54ea tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:46:08.586879 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0b98e683-bc76-4b04-a578-e1d6b4ed54ea tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 200 len: 1318 microversion: 2.1 time: 0.161295 Jan 10 11:46:08.587446 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 522/1054] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:46:08 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:46:09.274169 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-4d33b49e-a286-4226-ba21-ea8d5b577f58 req-1516a371-9ecd-4cbf-948e-6b3ace021bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48bc0af3-4371-47d7-ad76-d4205e75c03c", "tag": "6f646d78-6f3e-459e-95fa-73a3c78ab1f0"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:46:09.277316 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:46:09.277316 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:46:09.290273 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-4d33b49e-a286-4226-ba21-ea8d5b577f58 req-1516a371-9ecd-4cbf-948e-6b3ace021bb4 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:09.291320 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-4d33b49e-a286-4226-ba21-ea8d5b577f58 req-1516a371-9ecd-4cbf-948e-6b3ace021bb4 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:09.308341 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-4d33b49e-a286-4226-ba21-ea8d5b577f58 req-1516a371-9ecd-4cbf-948e-6b3ace021bb4 service nova] Creating event network-changed:6f646d78-6f3e-459e-95fa-73a3c78ab1f0 for instance 48bc0af3-4371-47d7-ad76-d4205e75c03c on hv-cinder-maste Jan 10 11:46:09.311666 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-4d33b49e-a286-4226-ba21-ea8d5b577f58 req-1516a371-9ecd-4cbf-948e-6b3ace021bb4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044992 Jan 10 11:46:09.312247 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 533/1055] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:46:09.603569 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-53b8ad73-351e-4234-942b-167fb8cb31dc tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:46:09.604418 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-53b8ad73-351e-4234-942b-167fb8cb31dc tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:46:09.614105 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-53b8ad73-351e-4234-942b-167fb8cb31dc tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:09.614866 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-53b8ad73-351e-4234-942b-167fb8cb31dc tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:09.615704 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-53b8ad73-351e-4234-942b-167fb8cb31dc tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:09.616150 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-53b8ad73-351e-4234-942b-167fb8cb31dc tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:09.758813 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-53b8ad73-351e-4234-942b-167fb8cb31dc tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:46:09.768563 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-53b8ad73-351e-4234-942b-167fb8cb31dc tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 200 len: 1318 microversion: 2.1 time: 0.168570 Jan 10 11:46:09.772762 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 523/1056] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:46:09 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:46:10.787770 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-43215249-5481-4cc6-824a-8d1192910409 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:46:10.788359 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-43215249-5481-4cc6-824a-8d1192910409 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:46:10.795315 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-43215249-5481-4cc6-824a-8d1192910409 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:10.795757 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-43215249-5481-4cc6-824a-8d1192910409 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:10.796547 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-43215249-5481-4cc6-824a-8d1192910409 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:10.796975 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-43215249-5481-4cc6-824a-8d1192910409 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:10.951117 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-43215249-5481-4cc6-824a-8d1192910409 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:46:10.962086 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-43215249-5481-4cc6-824a-8d1192910409 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 200 len: 1318 microversion: 2.1 time: 0.179701 Jan 10 11:46:10.962719 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 534/1057] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:46:10 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:46:11.992884 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-38f45f10-8b7c-49bd-a200-6f738fc58d66 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:46:11.993570 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-38f45f10-8b7c-49bd-a200-6f738fc58d66 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:46:12.000203 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-38f45f10-8b7c-49bd-a200-6f738fc58d66 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:12.003554 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-38f45f10-8b7c-49bd-a200-6f738fc58d66 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:12.003554 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-38f45f10-8b7c-49bd-a200-6f738fc58d66 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:12.003554 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-38f45f10-8b7c-49bd-a200-6f738fc58d66 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:12.139556 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-38f45f10-8b7c-49bd-a200-6f738fc58d66 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:46:12.147180 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-38f45f10-8b7c-49bd-a200-6f738fc58d66 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 200 len: 1318 microversion: 2.1 time: 0.158129 Jan 10 11:46:12.147744 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 524/1058] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:46:11 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:46:13.164630 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-6814ecf7-d61c-441a-849e-7dc6ffff5213 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:46:13.165236 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-6814ecf7-d61c-441a-849e-7dc6ffff5213 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:46:13.171785 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6814ecf7-d61c-441a-849e-7dc6ffff5213 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:13.172234 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6814ecf7-d61c-441a-849e-7dc6ffff5213 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:13.173058 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6814ecf7-d61c-441a-849e-7dc6ffff5213 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:13.173503 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6814ecf7-d61c-441a-849e-7dc6ffff5213 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:13.337244 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-6814ecf7-d61c-441a-849e-7dc6ffff5213 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:46:13.348207 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-6814ecf7-d61c-441a-849e-7dc6ffff5213 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 200 len: 1318 microversion: 2.1 time: 0.186976 Jan 10 11:46:13.349067 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 535/1059] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:46:13 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:46:14.373283 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-12d99f94-bd20-454d-a6a7-d14d1c96317e tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:46:14.374014 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-12d99f94-bd20-454d-a6a7-d14d1c96317e tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:46:14.382188 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-12d99f94-bd20-454d-a6a7-d14d1c96317e tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:14.382678 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-12d99f94-bd20-454d-a6a7-d14d1c96317e tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:14.383511 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-12d99f94-bd20-454d-a6a7-d14d1c96317e tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:14.383959 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-12d99f94-bd20-454d-a6a7-d14d1c96317e tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:14.552979 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-12d99f94-bd20-454d-a6a7-d14d1c96317e tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:46:14.561696 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-12d99f94-bd20-454d-a6a7-d14d1c96317e tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 200 len: 1318 microversion: 2.1 time: 0.192729 Jan 10 11:46:14.562373 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 525/1060] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:46:14 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:46:15.582582 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d4a67d28-156b-488c-9014-81090392b8d7 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:46:15.583422 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d4a67d28-156b-488c-9014-81090392b8d7 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:46:15.590332 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d4a67d28-156b-488c-9014-81090392b8d7 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:15.590787 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d4a67d28-156b-488c-9014-81090392b8d7 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:15.591593 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d4a67d28-156b-488c-9014-81090392b8d7 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:15.592031 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d4a67d28-156b-488c-9014-81090392b8d7 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:15.757119 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-1840c8b9-f523-4492-b6b4-1be09968f872 req-d5b7aa84-6b00-461a-a9f6-28ddd87158c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48bc0af3-4371-47d7-ad76-d4205e75c03c", "name": "network-vif-plugged", "status": "completed", "tag": "6f646d78-6f3e-459e-95fa-73a3c78ab1f0"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:46:15.760264 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:46:15.760264 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:46:15.769985 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-1840c8b9-f523-4492-b6b4-1be09968f872 req-d5b7aa84-6b00-461a-a9f6-28ddd87158c4 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:15.770736 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-1840c8b9-f523-4492-b6b4-1be09968f872 req-d5b7aa84-6b00-461a-a9f6-28ddd87158c4 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:15.773958 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-d4a67d28-156b-488c-9014-81090392b8d7 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:46:15.784771 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d4a67d28-156b-488c-9014-81090392b8d7 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 200 len: 1318 microversion: 2.1 time: 0.206405 Jan 10 11:46:15.790377 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 536/1061] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:46:15 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:46:15.790675 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-1840c8b9-f523-4492-b6b4-1be09968f872 req-d5b7aa84-6b00-461a-a9f6-28ddd87158c4 service nova] Creating event network-vif-plugged:6f646d78-6f3e-459e-95fa-73a3c78ab1f0 for instance 48bc0af3-4371-47d7-ad76-d4205e75c03c on hv-cinder-maste Jan 10 11:46:15.799311 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-1840c8b9-f523-4492-b6b4-1be09968f872 req-d5b7aa84-6b00-461a-a9f6-28ddd87158c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045959 Jan 10 11:46:15.800225 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 526/1062] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:46:16.804411 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-50948a48-fe2d-4475-b86f-e7710d867b0a tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:46:16.805017 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-50948a48-fe2d-4475-b86f-e7710d867b0a tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:46:16.811775 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-50948a48-fe2d-4475-b86f-e7710d867b0a tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:16.812225 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-50948a48-fe2d-4475-b86f-e7710d867b0a tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:16.813026 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-50948a48-fe2d-4475-b86f-e7710d867b0a tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:16.813464 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-50948a48-fe2d-4475-b86f-e7710d867b0a tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:16.970323 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-50948a48-fe2d-4475-b86f-e7710d867b0a tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:46:16.979361 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-50948a48-fe2d-4475-b86f-e7710d867b0a tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 200 len: 1318 microversion: 2.1 time: 0.178779 Jan 10 11:46:16.979956 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 537/1063] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:46:16 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:46:17.997932 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-fa13d5fd-34a0-4861-8489-3fb9908a35d1 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:46:17.998655 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-fa13d5fd-34a0-4861-8489-3fb9908a35d1 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:46:18.005232 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fa13d5fd-34a0-4861-8489-3fb9908a35d1 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:18.005687 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fa13d5fd-34a0-4861-8489-3fb9908a35d1 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:18.006513 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fa13d5fd-34a0-4861-8489-3fb9908a35d1 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:18.006960 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fa13d5fd-34a0-4861-8489-3fb9908a35d1 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:18.143181 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-fa13d5fd-34a0-4861-8489-3fb9908a35d1 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:46:18.150440 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-fa13d5fd-34a0-4861-8489-3fb9908a35d1 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 200 len: 1318 microversion: 2.1 time: 0.156990 Jan 10 11:46:18.151009 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 527/1064] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:46:17 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:46:19.167791 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7b0304a6-aecd-457c-afe2-6b6c183cda99 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:46:19.168406 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7b0304a6-aecd-457c-afe2-6b6c183cda99 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:46:19.174825 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7b0304a6-aecd-457c-afe2-6b6c183cda99 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:19.175284 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7b0304a6-aecd-457c-afe2-6b6c183cda99 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:19.176075 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7b0304a6-aecd-457c-afe2-6b6c183cda99 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:19.176521 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7b0304a6-aecd-457c-afe2-6b6c183cda99 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:19.314385 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-7b0304a6-aecd-457c-afe2-6b6c183cda99 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:46:19.322136 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7b0304a6-aecd-457c-afe2-6b6c183cda99 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 200 len: 1318 microversion: 2.1 time: 0.157930 Jan 10 11:46:19.322753 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 538/1065] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:46:19 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:46:20.340899 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-590c7cbc-fe4c-4dd7-a641-84e793ab38a9 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:46:20.341723 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-590c7cbc-fe4c-4dd7-a641-84e793ab38a9 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:46:20.350631 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-590c7cbc-fe4c-4dd7-a641-84e793ab38a9 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:20.351295 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-590c7cbc-fe4c-4dd7-a641-84e793ab38a9 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:20.352318 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-590c7cbc-fe4c-4dd7-a641-84e793ab38a9 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:20.352881 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-590c7cbc-fe4c-4dd7-a641-84e793ab38a9 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:20.541595 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-590c7cbc-fe4c-4dd7-a641-84e793ab38a9 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:46:20.552989 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-590c7cbc-fe4c-4dd7-a641-84e793ab38a9 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 200 len: 1508 microversion: 2.1 time: 0.216067 Jan 10 11:46:20.553852 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 528/1066] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:46:20 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:46:40.741461 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-d3e97c7e-359a-4ec7-bf3e-6d0259f20890 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1e7131d-73f5-4796-8dcc-27e33d247c56", "device": "/dev/sdb"}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:46:40.743391 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-d3e97c7e-359a-4ec7-bf3e-6d0259f20890 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:46:40.751090 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d3e97c7e-359a-4ec7-bf3e-6d0259f20890 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:40.751535 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d3e97c7e-359a-4ec7-bf3e-6d0259f20890 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:40.752351 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d3e97c7e-359a-4ec7-bf3e-6d0259f20890 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:46:40.752787 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-d3e97c7e-359a-4ec7-bf3e-6d0259f20890 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:46:41.690869 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-d3e97c7e-359a-4ec7-bf3e-6d0259f20890 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "POST /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.953000 Jan 10 11:46:41.692116 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 539/1067] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jan 10 11:46:40 2022] POST /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c/os-volume_attachments => generated 194 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:47:07.327162 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-dbae29b7-8d58-4f53-aa03-fe76435968d8 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:07.328123 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-dbae29b7-8d58-4f53-aa03-fe76435968d8 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:07.342095 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dbae29b7-8d58-4f53-aa03-fe76435968d8 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:07.342930 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dbae29b7-8d58-4f53-aa03-fe76435968d8 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:07.344394 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dbae29b7-8d58-4f53-aa03-fe76435968d8 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:07.345379 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dbae29b7-8d58-4f53-aa03-fe76435968d8 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:07.444589 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.objects.instance [None req-dbae29b7-8d58-4f53-aa03-fe76435968d8 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lazy-loading 'services' on Instance uuid 48bc0af3-4371-47d7-ad76-d4205e75c03c {{(pid=128718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:47:07.769562 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-dbae29b7-8d58-4f53-aa03-fe76435968d8 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "DELETE /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c/os-volume_attachments/b1e7131d-73f5-4796-8dcc-27e33d247c56" status: 202 len: 0 microversion: 2.1 time: 0.446861 Jan 10 11:47:07.775729 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 529/1068] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jan 10 11:47:07 2022] DELETE /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c/os-volume_attachments/b1e7131d-73f5-4796-8dcc-27e33d247c56 => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 10 11:47:08.976188 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f213fd1d-e99a-4ac7-abee-39f28ca34e4d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:08.977007 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f213fd1d-e99a-4ac7-abee-39f28ca34e4d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:08.991703 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f213fd1d-e99a-4ac7-abee-39f28ca34e4d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:08.992530 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f213fd1d-e99a-4ac7-abee-39f28ca34e4d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:08.993879 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f213fd1d-e99a-4ac7-abee-39f28ca34e4d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:08.994713 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f213fd1d-e99a-4ac7-abee-39f28ca34e4d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:09.047889 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f213fd1d-e99a-4ac7-abee-39f28ca34e4d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Going to try to terminate instance {{(pid=128719) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:47:09.583101 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f213fd1d-e99a-4ac7-abee-39f28ca34e4d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "DELETE /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 204 len: 0 microversion: 2.1 time: 0.611231 Jan 10 11:47:09.584038 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 540/1069] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:47:08 2022] DELETE /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 0 bytes in 615 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:47:09.601649 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4aa1d8a1-e189-4eb3-bb88-b96056c777a7 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:09.603599 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4aa1d8a1-e189-4eb3-bb88-b96056c777a7 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:09.619236 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4aa1d8a1-e189-4eb3-bb88-b96056c777a7 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:09.620053 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4aa1d8a1-e189-4eb3-bb88-b96056c777a7 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:09.621751 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4aa1d8a1-e189-4eb3-bb88-b96056c777a7 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:09.624276 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4aa1d8a1-e189-4eb3-bb88-b96056c777a7 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:09.892160 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4aa1d8a1-e189-4eb3-bb88-b96056c777a7 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:09.906476 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4aa1d8a1-e189-4eb3-bb88-b96056c777a7 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 200 len: 1514 microversion: 2.1 time: 0.316774 Jan 10 11:47:09.922360 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 530/1070] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:09 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 1514 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:10.938785 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-21a51538-7df8-4409-96a1-a63d21e59a68 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:10.942710 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-21a51538-7df8-4409-96a1-a63d21e59a68 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:10.954851 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-21a51538-7df8-4409-96a1-a63d21e59a68 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:10.955668 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-21a51538-7df8-4409-96a1-a63d21e59a68 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:10.957723 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-21a51538-7df8-4409-96a1-a63d21e59a68 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:10.958771 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-21a51538-7df8-4409-96a1-a63d21e59a68 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:11.179820 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-21a51538-7df8-4409-96a1-a63d21e59a68 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:11.192573 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-21a51538-7df8-4409-96a1-a63d21e59a68 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 200 len: 1514 microversion: 2.1 time: 0.261656 Jan 10 11:47:11.193833 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 541/1071] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:10 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 1514 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:11.887866 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-d8bdfd53-34c7-4334-ae8a-b32e66940ddc req-bed9ef52-8937-4da1-996f-7f6f81b0e48f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48bc0af3-4371-47d7-ad76-d4205e75c03c", "name": "network-vif-deleted", "tag": "6f646d78-6f3e-459e-95fa-73a3c78ab1f0"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:47:11.890863 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:47:11.890863 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:47:11.900587 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-d8bdfd53-34c7-4334-ae8a-b32e66940ddc req-bed9ef52-8937-4da1-996f-7f6f81b0e48f service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:11.901190 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-d8bdfd53-34c7-4334-ae8a-b32e66940ddc req-bed9ef52-8937-4da1-996f-7f6f81b0e48f service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:11.928847 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-d8bdfd53-34c7-4334-ae8a-b32e66940ddc req-bed9ef52-8937-4da1-996f-7f6f81b0e48f service nova] Creating event network-vif-deleted:6f646d78-6f3e-459e-95fa-73a3c78ab1f0 for instance 48bc0af3-4371-47d7-ad76-d4205e75c03c on hv-cinder-maste Jan 10 11:47:11.934588 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-d8bdfd53-34c7-4334-ae8a-b32e66940ddc req-bed9ef52-8937-4da1-996f-7f6f81b0e48f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050364 Jan 10 11:47:11.935374 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 531/1072] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:47:12.223352 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-931c235d-3586-4ff2-aa3d-befd795e4cab tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:12.224903 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-931c235d-3586-4ff2-aa3d-befd795e4cab tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:12.234622 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-931c235d-3586-4ff2-aa3d-befd795e4cab tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:12.235085 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-931c235d-3586-4ff2-aa3d-befd795e4cab tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:12.235951 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-931c235d-3586-4ff2-aa3d-befd795e4cab tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:12.236468 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-931c235d-3586-4ff2-aa3d-befd795e4cab tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:12.320793 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-931c235d-3586-4ff2-aa3d-befd795e4cab tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:12.333895 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-931c235d-3586-4ff2-aa3d-befd795e4cab tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 200 len: 1303 microversion: 2.1 time: 0.116991 Jan 10 11:47:12.334553 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 542/1073] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:12 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:13.316720 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3b8be5a9-74b2-4ada-a2b9-0c599ccbe37c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Action: 'create', calling method: .version_select at 0x7f47799533a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1006001352"}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:47:13.340277 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-3b8be5a9-74b2-4ada-a2b9-0c599ccbe37c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Getting quotas for project 3f1d77884a2a4a7ebb85ba71e9d864a7. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:47:13.340277 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-3b8be5a9-74b2-4ada-a2b9-0c599ccbe37c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Getting quotas for user fa0eed1277c2418ca9f815589ab58896 and project 3f1d77884a2a4a7ebb85ba71e9d864a7. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:47:13.347417 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3b8be5a9-74b2-4ada-a2b9-0c599ccbe37c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [107db59e-27b2-4daa-9c79-786e64569f3a] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 10 11:47:13.352110 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-6f5a971c-8894-4d55-8d3f-89377394601d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:13.352972 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-6f5a971c-8894-4d55-8d3f-89377394601d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: 48bc0af3-4371-47d7-ad76-d4205e75c03c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:13.360687 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6f5a971c-8894-4d55-8d3f-89377394601d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:13.361147 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6f5a971c-8894-4d55-8d3f-89377394601d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:13.364300 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6f5a971c-8894-4d55-8d3f-89377394601d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:13.364300 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6f5a971c-8894-4d55-8d3f-89377394601d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:13.379284 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-6f5a971c-8894-4d55-8d3f-89377394601d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] HTTP exception thrown: Instance 48bc0af3-4371-47d7-ad76-d4205e75c03c could not be found. Jan 10 11:47:13.380065 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-6f5a971c-8894-4d55-8d3f-89377394601d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Returning 404 to user: Instance 48bc0af3-4371-47d7-ad76-d4205e75c03c could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:47:13.380901 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-6f5a971c-8894-4d55-8d3f-89377394601d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c" status: 404 len: 111 microversion: 2.1 time: 0.032878 Jan 10 11:47:13.381452 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 543/1074] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:13 2022] GET /compute/v2.1/servers/48bc0af3-4371-47d7-ad76-d4205e75c03c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 10 11:47:14.355188 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO oslo.messaging._drivers.impl_rabbit [None req-3b8be5a9-74b2-4ada-a2b9-0c599ccbe37c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [107db59e-27b2-4daa-9c79-786e64569f3a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 59876. Jan 10 11:47:14.674358 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-3b8be5a9-74b2-4ada-a2b9-0c599ccbe37c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Getting quotas for project 3f1d77884a2a4a7ebb85ba71e9d864a7. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:47:14.680269 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-3b8be5a9-74b2-4ada-a2b9-0c599ccbe37c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Getting quotas for user fa0eed1277c2418ca9f815589ab58896 and project 3f1d77884a2a4a7ebb85ba71e9d864a7. Resources: {'key_pairs'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:47:14.698467 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3b8be5a9-74b2-4ada-a2b9-0c599ccbe37c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.622660 Jan 10 11:47:14.698986 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 532/1075] 10.222.0.20 () {60 vars in 1157 bytes} [Mon Jan 10 11:47:13 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:23.404606 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-4d53b5ae-d1d4-42a6-a246-fe7f112d1e7b tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1189845051", "imageRef": "b6e63192-9c33-4d80-9555-6de2bb10fd32", "flavorRef": "452", "networks": [{"uuid": "e5d4369a-3d75-409b-831d-a85be7aee434"}]}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:47:23.462799 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.network.neutron [None req-4d53b5ae-d1d4-42a6-a246-fe7f112d1e7b tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] validate_networks() for [('e5d4369a-3d75-409b-831d-a85be7aee434', None, None, None, None, None)] {{(pid=128719) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:47:23.942043 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-4d53b5ae-d1d4-42a6-a246-fe7f112d1e7b tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Flavor limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:47:23.942670 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-4d53b5ae-d1d4-42a6-a246-fe7f112d1e7b tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Image limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:47:23.943228 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-4d53b5ae-d1d4-42a6-a246-fe7f112d1e7b tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Flavor pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:47:23.943833 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-4d53b5ae-d1d4-42a6-a246-fe7f112d1e7b tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Image pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:47:23.945164 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-4d53b5ae-d1d4-42a6-a246-fe7f112d1e7b tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:47:23.958026 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4d53b5ae-d1d4-42a6-a246-fe7f112d1e7b tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:23.958513 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4d53b5ae-d1d4-42a6-a246-fe7f112d1e7b tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:23.959403 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4d53b5ae-d1d4-42a6-a246-fe7f112d1e7b tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:23.959855 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4d53b5ae-d1d4-42a6-a246-fe7f112d1e7b tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:23.979242 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-4d53b5ae-d1d4-42a6-a246-fe7f112d1e7b tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Getting quotas for project 77459867f2ca40c6aac9eebdcfed7ca2. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:47:23.984084 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-4d53b5ae-d1d4-42a6-a246-fe7f112d1e7b tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Getting quotas for user 170dcc817fa34bc781ffe7fedf729b88 and project 77459867f2ca40c6aac9eebdcfed7ca2. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:47:24.003371 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-4d53b5ae-d1d4-42a6-a246-fe7f112d1e7b tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Going to run 1 instances... {{(pid=128719) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:47:24.005818 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-4d53b5ae-d1d4-42a6-a246-fe7f112d1e7b tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b6e63192-9c33-4d80-9555-6de2bb10fd32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:47:24.130439 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-4d53b5ae-d1d4-42a6-a246-fe7f112d1e7b tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729348 Jan 10 11:47:24.131404 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 544/1076] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:47:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 11:47:24.147399 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-07eaf1f4-232a-4e06-8314-edb02a1e3d3d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:24.148686 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-07eaf1f4-232a-4e06-8314-edb02a1e3d3d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:24.228066 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-07eaf1f4-232a-4e06-8314-edb02a1e3d3d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:24.235845 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-07eaf1f4-232a-4e06-8314-edb02a1e3d3d tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c" status: 200 len: 1219 microversion: 2.1 time: 0.094636 Jan 10 11:47:24.236650 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 533/1077] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:24 2022] GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:25.266968 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-a0fcab5c-0280-4efd-9dd5-bce7e05d5761 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:25.267979 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-a0fcab5c-0280-4efd-9dd5-bce7e05d5761 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:25.280564 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a0fcab5c-0280-4efd-9dd5-bce7e05d5761 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:25.281015 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a0fcab5c-0280-4efd-9dd5-bce7e05d5761 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:25.281858 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a0fcab5c-0280-4efd-9dd5-bce7e05d5761 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:25.282981 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-a0fcab5c-0280-4efd-9dd5-bce7e05d5761 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:25.351010 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-a0fcab5c-0280-4efd-9dd5-bce7e05d5761 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:25.359191 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-a0fcab5c-0280-4efd-9dd5-bce7e05d5761 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c" status: 200 len: 1223 microversion: 2.1 time: 0.097009 Jan 10 11:47:25.360055 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 545/1078] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:25 2022] GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:26.376517 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ad55ff5a-3174-4614-9954-e311818f0260 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:26.377148 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ad55ff5a-3174-4614-9954-e311818f0260 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:26.383421 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ad55ff5a-3174-4614-9954-e311818f0260 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:26.383866 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ad55ff5a-3174-4614-9954-e311818f0260 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:26.384766 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ad55ff5a-3174-4614-9954-e311818f0260 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:26.385222 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ad55ff5a-3174-4614-9954-e311818f0260 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:26.460338 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ad55ff5a-3174-4614-9954-e311818f0260 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:26.468806 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ad55ff5a-3174-4614-9954-e311818f0260 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c" status: 200 len: 1271 microversion: 2.1 time: 0.096093 Jan 10 11:47:26.469411 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 534/1079] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:26 2022] GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:27.487616 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-528954a9-435e-4bd3-9795-0929fe1c2678 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:27.488661 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-528954a9-435e-4bd3-9795-0929fe1c2678 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:27.497492 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-528954a9-435e-4bd3-9795-0929fe1c2678 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:27.497945 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-528954a9-435e-4bd3-9795-0929fe1c2678 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:27.498775 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-528954a9-435e-4bd3-9795-0929fe1c2678 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:27.499216 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-528954a9-435e-4bd3-9795-0929fe1c2678 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:27.569086 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-528954a9-435e-4bd3-9795-0929fe1c2678 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:27.578554 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-528954a9-435e-4bd3-9795-0929fe1c2678 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c" status: 200 len: 1277 microversion: 2.1 time: 0.095437 Jan 10 11:47:27.579204 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 546/1080] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:27 2022] GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c => generated 1277 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:47:28.597079 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-d0a8fba0-2005-4388-8a87-0744d89b39ae tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:28.597758 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-d0a8fba0-2005-4388-8a87-0744d89b39ae tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:28.604313 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d0a8fba0-2005-4388-8a87-0744d89b39ae tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:28.604807 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d0a8fba0-2005-4388-8a87-0744d89b39ae tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:28.670162 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d0a8fba0-2005-4388-8a87-0744d89b39ae tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:28.670162 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d0a8fba0-2005-4388-8a87-0744d89b39ae tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:28.768477 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-b0c38a97-501a-44fd-acd8-cc6cadc655ce req-6dd1535a-0875-48f5-89ce-bcd13ff3ff99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5f5525f-cd23-4529-9e01-37d87411475c", "tag": "cbc9ee38-826b-44c2-9204-d3f7474dbf8c"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:47:28.772327 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:47:28.772327 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:47:28.785374 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-b0c38a97-501a-44fd-acd8-cc6cadc655ce req-6dd1535a-0875-48f5-89ce-bcd13ff3ff99 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:28.786612 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-b0c38a97-501a-44fd-acd8-cc6cadc655ce req-6dd1535a-0875-48f5-89ce-bcd13ff3ff99 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:28.787587 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-d0a8fba0-2005-4388-8a87-0744d89b39ae tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:28.802887 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-b0c38a97-501a-44fd-acd8-cc6cadc655ce req-6dd1535a-0875-48f5-89ce-bcd13ff3ff99 service nova] Creating event network-changed:cbc9ee38-826b-44c2-9204-d3f7474dbf8c for instance b5f5525f-cd23-4529-9e01-37d87411475c on hv-cinder-maste Jan 10 11:47:28.811080 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-b0c38a97-501a-44fd-acd8-cc6cadc655ce req-6dd1535a-0875-48f5-89ce-bcd13ff3ff99 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049479 Jan 10 11:47:28.811695 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 547/1081] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:47:28.819537 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-d0a8fba0-2005-4388-8a87-0744d89b39ae tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c" status: 200 len: 1319 microversion: 2.1 time: 0.222437 Jan 10 11:47:28.819537 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 535/1082] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:28 2022] GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:29.841676 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f0905981-adb8-46db-822e-7981f90c0292 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:29.842477 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f0905981-adb8-46db-822e-7981f90c0292 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:29.849105 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f0905981-adb8-46db-822e-7981f90c0292 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:29.849559 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f0905981-adb8-46db-822e-7981f90c0292 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:29.850404 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f0905981-adb8-46db-822e-7981f90c0292 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:29.850848 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f0905981-adb8-46db-822e-7981f90c0292 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:29.996603 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-f0905981-adb8-46db-822e-7981f90c0292 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:30.008320 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f0905981-adb8-46db-822e-7981f90c0292 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c" status: 200 len: 1319 microversion: 2.1 time: 0.179022 Jan 10 11:47:30.009163 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 548/1083] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:29 2022] GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:31.024989 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ea673b9c-2889-49e0-a658-7e8d98894c4a tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:31.025839 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ea673b9c-2889-49e0-a658-7e8d98894c4a tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:31.033591 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ea673b9c-2889-49e0-a658-7e8d98894c4a tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:31.034049 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ea673b9c-2889-49e0-a658-7e8d98894c4a tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:31.034892 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ea673b9c-2889-49e0-a658-7e8d98894c4a tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:31.035342 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ea673b9c-2889-49e0-a658-7e8d98894c4a tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:31.342232 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ea673b9c-2889-49e0-a658-7e8d98894c4a tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:31.350852 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ea673b9c-2889-49e0-a658-7e8d98894c4a tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c" status: 200 len: 1319 microversion: 2.1 time: 0.329533 Jan 10 11:47:31.351441 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 536/1084] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:31 2022] GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:32.368779 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-b9cebdf6-fc0e-456e-a63d-a6d7569d7abe tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:32.369307 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-b9cebdf6-fc0e-456e-a63d-a6d7569d7abe tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:32.376540 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b9cebdf6-fc0e-456e-a63d-a6d7569d7abe tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:32.377205 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b9cebdf6-fc0e-456e-a63d-a6d7569d7abe tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:32.378392 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b9cebdf6-fc0e-456e-a63d-a6d7569d7abe tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:32.378979 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-b9cebdf6-fc0e-456e-a63d-a6d7569d7abe tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:32.519155 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-b9cebdf6-fc0e-456e-a63d-a6d7569d7abe tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:32.526741 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-b9cebdf6-fc0e-456e-a63d-a6d7569d7abe tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c" status: 200 len: 1319 microversion: 2.1 time: 0.161661 Jan 10 11:47:32.527323 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 549/1085] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:32 2022] GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:33.281735 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [req-03472c28-e1af-4723-abe7-5a45e6185339 req-89fc33d2-0012-4b08-bc59-6891396a7e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5f5525f-cd23-4529-9e01-37d87411475c", "name": "network-vif-plugged", "status": "completed", "tag": "cbc9ee38-826b-44c2-9204-d3f7474dbf8c"}]} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:47:33.283420 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:47:33.283420 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: warnings.warn(msg) Jan 10 11:47:33.299906 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-03472c28-e1af-4723-abe7-5a45e6185339 req-89fc33d2-0012-4b08-bc59-6891396a7e75 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:33.300391 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [req-03472c28-e1af-4723-abe7-5a45e6185339 req-89fc33d2-0012-4b08-bc59-6891396a7e75 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:33.313362 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.compute.server_external_events [req-03472c28-e1af-4723-abe7-5a45e6185339 req-89fc33d2-0012-4b08-bc59-6891396a7e75 service nova] Creating event network-vif-plugged:cbc9ee38-826b-44c2-9204-d3f7474dbf8c for instance b5f5525f-cd23-4529-9e01-37d87411475c on hv-cinder-maste Jan 10 11:47:33.319560 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [req-03472c28-e1af-4723-abe7-5a45e6185339 req-89fc33d2-0012-4b08-bc59-6891396a7e75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041047 Jan 10 11:47:33.320328 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 537/1086] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:47:33.544415 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-69bacfeb-4db0-45ae-9b57-7c5c714ec717 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:33.544987 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-69bacfeb-4db0-45ae-9b57-7c5c714ec717 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:33.553023 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-69bacfeb-4db0-45ae-9b57-7c5c714ec717 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:33.553487 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-69bacfeb-4db0-45ae-9b57-7c5c714ec717 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:33.554338 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-69bacfeb-4db0-45ae-9b57-7c5c714ec717 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:33.554831 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-69bacfeb-4db0-45ae-9b57-7c5c714ec717 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:33.741228 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-69bacfeb-4db0-45ae-9b57-7c5c714ec717 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:33.750016 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-69bacfeb-4db0-45ae-9b57-7c5c714ec717 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c" status: 200 len: 1319 microversion: 2.1 time: 0.208855 Jan 10 11:47:33.750825 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 550/1087] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:33 2022] GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:34.769480 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3245e328-99fb-4aab-a47e-12af20edaac0 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:34.770106 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3245e328-99fb-4aab-a47e-12af20edaac0 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:34.776319 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3245e328-99fb-4aab-a47e-12af20edaac0 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:34.776769 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3245e328-99fb-4aab-a47e-12af20edaac0 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:34.777552 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3245e328-99fb-4aab-a47e-12af20edaac0 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:34.777992 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3245e328-99fb-4aab-a47e-12af20edaac0 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:34.923564 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3245e328-99fb-4aab-a47e-12af20edaac0 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:34.931743 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3245e328-99fb-4aab-a47e-12af20edaac0 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c" status: 200 len: 1319 microversion: 2.1 time: 0.166906 Jan 10 11:47:34.932336 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 538/1088] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:34 2022] GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:35.949220 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2dd7af97-b799-410f-be4f-2fab0452d7a1 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:35.949881 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2dd7af97-b799-410f-be4f-2fab0452d7a1 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:35.957936 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2dd7af97-b799-410f-be4f-2fab0452d7a1 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:35.958443 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2dd7af97-b799-410f-be4f-2fab0452d7a1 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:35.959667 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2dd7af97-b799-410f-be4f-2fab0452d7a1 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:35.960171 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2dd7af97-b799-410f-be4f-2fab0452d7a1 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:36.254567 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2dd7af97-b799-410f-be4f-2fab0452d7a1 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:36.267107 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2dd7af97-b799-410f-be4f-2fab0452d7a1 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c" status: 200 len: 1509 microversion: 2.1 time: 0.321737 Jan 10 11:47:36.270618 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 551/1089] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:35 2022] GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:47:36.288893 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b0d13150-82d2-4a47-b3c2-e95830cc7989 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7593864-8079-4b68-91f5-4141cfef25fb", "device": "/dev/sdb"}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:47:36.290932 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b0d13150-82d2-4a47-b3c2-e95830cc7989 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:36.300312 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b0d13150-82d2-4a47-b3c2-e95830cc7989 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:36.300870 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b0d13150-82d2-4a47-b3c2-e95830cc7989 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:36.302813 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b0d13150-82d2-4a47-b3c2-e95830cc7989 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:36.303272 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b0d13150-82d2-4a47-b3c2-e95830cc7989 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:37.146511 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b0d13150-82d2-4a47-b3c2-e95830cc7989 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "POST /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.863202 Jan 10 11:47:37.147414 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 539/1090] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Jan 10 11:47:36 2022] POST /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c/os-volume_attachments => generated 194 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:47:37.697881 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7fd1f030-b608-4885-8534-128465831ce2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1975955272", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1006001352", "security_groups": [{"name": "tempest-secgroup-smoke-1361997568"}], "block_device_mapping_v2": [{"uuid": "58108d6a-9c6b-43b0-999d-ceb6bc81fbb4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "92f5a063-7815-44d4-b602-8402ae90a4bb"}]}} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:47:37.871932 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.network.neutron [None req-7fd1f030-b608-4885-8534-128465831ce2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] validate_networks() for [('92f5a063-7815-44d4-b602-8402ae90a4bb', None, None, None, None, None)] {{(pid=128719) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:47:38.374919 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-7fd1f030-b608-4885-8534-128465831ce2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Flavor limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:47:38.375471 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-7fd1f030-b608-4885-8534-128465831ce2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Image limits 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:47:38.376175 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-7fd1f030-b608-4885-8534-128465831ce2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Flavor pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:47:38.376663 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-7fd1f030-b608-4885-8534-128465831ce2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Image pref 0:0:0 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:47:38.377133 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.virt.hardware [None req-7fd1f030-b608-4885-8534-128465831ce2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:47:38.393273 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7fd1f030-b608-4885-8534-128465831ce2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:38.393770 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7fd1f030-b608-4885-8534-128465831ce2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:38.396422 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7fd1f030-b608-4885-8534-128465831ce2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:38.397339 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7fd1f030-b608-4885-8534-128465831ce2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:38.425074 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-7fd1f030-b608-4885-8534-128465831ce2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Getting quotas for project 3f1d77884a2a4a7ebb85ba71e9d864a7. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:47:38.430201 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.quota [None req-7fd1f030-b608-4885-8534-128465831ce2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Getting quotas for user fa0eed1277c2418ca9f815589ab58896 and project 3f1d77884a2a4a7ebb85ba71e9d864a7. Resources: {'cores', 'ram', 'instances'} {{(pid=128719) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:47:38.506239 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7fd1f030-b608-4885-8534-128465831ce2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Going to run 1 instances... {{(pid=128719) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:47:38.508602 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7fd1f030-b608-4885-8534-128465831ce2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='58108d6a-9c6b-43b0-999d-ceb6bc81fbb4',volume_size=None,volume_type=None)] {{(pid=128719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:47:39.100167 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7fd1f030-b608-4885-8534-128465831ce2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.406737 Jan 10 11:47:39.101139 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 552/1091] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:47:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 10 11:47:39.117115 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-db90f5bc-e4d3-44b9-984a-7e69c5e78823 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:39.118001 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-db90f5bc-e4d3-44b9-984a-7e69c5e78823 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:39.176138 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-db90f5bc-e4d3-44b9-984a-7e69c5e78823 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:39.187966 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-db90f5bc-e4d3-44b9-984a-7e69c5e78823 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1095 microversion: 2.1 time: 0.078781 Jan 10 11:47:39.189023 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 540/1092] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:39 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:40.207433 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-021186c5-c161-4543-8f1a-c32a31eaa289 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:40.208046 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-021186c5-c161-4543-8f1a-c32a31eaa289 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:40.265548 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-021186c5-c161-4543-8f1a-c32a31eaa289 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:40.273302 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-021186c5-c161-4543-8f1a-c32a31eaa289 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1095 microversion: 2.1 time: 0.069746 Jan 10 11:47:40.273899 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 553/1093] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:40 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:41.291017 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-47c3dc03-1ae3-4a06-b4bf-36c3c41981b7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:41.291629 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-47c3dc03-1ae3-4a06-b4bf-36c3c41981b7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:41.299296 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-47c3dc03-1ae3-4a06-b4bf-36c3c41981b7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:41.299742 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-47c3dc03-1ae3-4a06-b4bf-36c3c41981b7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:41.300558 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-47c3dc03-1ae3-4a06-b4bf-36c3c41981b7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:41.301182 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-47c3dc03-1ae3-4a06-b4bf-36c3c41981b7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:41.360612 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-47c3dc03-1ae3-4a06-b4bf-36c3c41981b7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:41.368387 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-47c3dc03-1ae3-4a06-b4bf-36c3c41981b7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1193 microversion: 2.1 time: 0.081120 Jan 10 11:47:41.368971 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 541/1094] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:41 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1193 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:42.386480 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-fe102609-d562-4c14-9fe7-023eeae4ad33 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:42.387320 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-fe102609-d562-4c14-9fe7-023eeae4ad33 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:42.394499 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fe102609-d562-4c14-9fe7-023eeae4ad33 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:42.394951 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fe102609-d562-4c14-9fe7-023eeae4ad33 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:42.395768 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fe102609-d562-4c14-9fe7-023eeae4ad33 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:42.396206 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fe102609-d562-4c14-9fe7-023eeae4ad33 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:42.479529 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-fe102609-d562-4c14-9fe7-023eeae4ad33 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:42.489563 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-fe102609-d562-4c14-9fe7-023eeae4ad33 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1211 microversion: 2.1 time: 0.106951 Jan 10 11:47:42.490831 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 554/1095] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:42 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:43.516997 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-bdb68d13-2707-4e17-99b5-48189ae684d0 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:43.520725 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-bdb68d13-2707-4e17-99b5-48189ae684d0 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:43.526363 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bdb68d13-2707-4e17-99b5-48189ae684d0 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:43.527676 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bdb68d13-2707-4e17-99b5-48189ae684d0 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:43.528029 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bdb68d13-2707-4e17-99b5-48189ae684d0 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:43.529958 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bdb68d13-2707-4e17-99b5-48189ae684d0 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:43.680571 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-bdb68d13-2707-4e17-99b5-48189ae684d0 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:43.689203 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-bdb68d13-2707-4e17-99b5-48189ae684d0 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1279 microversion: 2.1 time: 0.177128 Jan 10 11:47:43.689798 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 542/1096] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:43 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:44.226637 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-df7a6ac5-0782-443d-aecb-6152a2f51e1e req-882522fa-867b-4d52-ab8d-97b874700fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c47fc785-2072-4e05-9f7b-f95dbc2757d2", "tag": "a39e281b-2b52-4b5d-b8e6-6a5a4222b744"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:47:44.235286 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:47:44.235286 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:47:44.245786 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-df7a6ac5-0782-443d-aecb-6152a2f51e1e req-882522fa-867b-4d52-ab8d-97b874700fc8 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:44.246589 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-df7a6ac5-0782-443d-aecb-6152a2f51e1e req-882522fa-867b-4d52-ab8d-97b874700fc8 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:44.270190 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-df7a6ac5-0782-443d-aecb-6152a2f51e1e req-882522fa-867b-4d52-ab8d-97b874700fc8 service nova] Creating event network-changed:a39e281b-2b52-4b5d-b8e6-6a5a4222b744 for instance c47fc785-2072-4e05-9f7b-f95dbc2757d2 on hv-cinder-maste Jan 10 11:47:44.277467 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-df7a6ac5-0782-443d-aecb-6152a2f51e1e req-882522fa-867b-4d52-ab8d-97b874700fc8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058792 Jan 10 11:47:44.278135 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 555/1097] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:47:44.706151 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0b2417bb-e6f6-443a-8b50-bed5dc693eeb tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:44.707718 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0b2417bb-e6f6-443a-8b50-bed5dc693eeb tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:44.716156 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0b2417bb-e6f6-443a-8b50-bed5dc693eeb tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:44.716937 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0b2417bb-e6f6-443a-8b50-bed5dc693eeb tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:44.718031 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0b2417bb-e6f6-443a-8b50-bed5dc693eeb tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:44.718754 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0b2417bb-e6f6-443a-8b50-bed5dc693eeb tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:44.919017 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0b2417bb-e6f6-443a-8b50-bed5dc693eeb tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:44.927556 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0b2417bb-e6f6-443a-8b50-bed5dc693eeb tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1279 microversion: 2.1 time: 0.225689 Jan 10 11:47:44.930771 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 543/1098] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:44 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1279 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:45.947959 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2bc3166d-d464-4940-a815-051f802a34d4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:45.948702 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2bc3166d-d464-4940-a815-051f802a34d4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:45.958308 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2bc3166d-d464-4940-a815-051f802a34d4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:45.958761 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2bc3166d-d464-4940-a815-051f802a34d4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:45.959562 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2bc3166d-d464-4940-a815-051f802a34d4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:45.960004 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2bc3166d-d464-4940-a815-051f802a34d4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:46.146678 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2bc3166d-d464-4940-a815-051f802a34d4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:46.161317 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2bc3166d-d464-4940-a815-051f802a34d4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1279 microversion: 2.1 time: 0.220047 Jan 10 11:47:46.161960 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 556/1099] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:45 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1279 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:47.180961 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-02488cca-399a-471a-90d2-93368d487e92 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:47.181575 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-02488cca-399a-471a-90d2-93368d487e92 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:47.191802 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-02488cca-399a-471a-90d2-93368d487e92 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:47.192442 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-02488cca-399a-471a-90d2-93368d487e92 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:47.193700 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-02488cca-399a-471a-90d2-93368d487e92 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:47.194259 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-02488cca-399a-471a-90d2-93368d487e92 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:47.352327 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-02488cca-399a-471a-90d2-93368d487e92 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:47.361779 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-02488cca-399a-471a-90d2-93368d487e92 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1267 microversion: 2.1 time: 0.184443 Jan 10 11:47:47.366833 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 544/1100] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:47 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:48.384423 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-121e9a3e-1590-4ccc-a885-3b2fa760682f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:48.384982 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-121e9a3e-1590-4ccc-a885-3b2fa760682f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:48.392839 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-121e9a3e-1590-4ccc-a885-3b2fa760682f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:48.393287 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-121e9a3e-1590-4ccc-a885-3b2fa760682f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:48.394077 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-121e9a3e-1590-4ccc-a885-3b2fa760682f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:48.394547 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-121e9a3e-1590-4ccc-a885-3b2fa760682f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:48.551730 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-121e9a3e-1590-4ccc-a885-3b2fa760682f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:48.560628 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-121e9a3e-1590-4ccc-a885-3b2fa760682f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1267 microversion: 2.1 time: 0.179894 Jan 10 11:47:48.561219 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 557/1101] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:48 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:49.581983 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-22e7213c-e0c0-474f-a741-8e3152026b07 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:49.582769 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-22e7213c-e0c0-474f-a741-8e3152026b07 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:49.590751 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-22e7213c-e0c0-474f-a741-8e3152026b07 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:49.590751 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-22e7213c-e0c0-474f-a741-8e3152026b07 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:49.591481 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-22e7213c-e0c0-474f-a741-8e3152026b07 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:49.591927 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-22e7213c-e0c0-474f-a741-8e3152026b07 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:49.774095 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-22e7213c-e0c0-474f-a741-8e3152026b07 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:49.785500 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-22e7213c-e0c0-474f-a741-8e3152026b07 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1267 microversion: 2.1 time: 0.206927 Jan 10 11:47:49.786556 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 545/1102] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:49 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:50.806194 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f9e1dd97-48b8-4d78-86a5-024ac04f2f58 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:50.806928 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f9e1dd97-48b8-4d78-86a5-024ac04f2f58 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:50.816627 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f9e1dd97-48b8-4d78-86a5-024ac04f2f58 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:50.817264 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f9e1dd97-48b8-4d78-86a5-024ac04f2f58 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:50.818180 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f9e1dd97-48b8-4d78-86a5-024ac04f2f58 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:50.818817 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f9e1dd97-48b8-4d78-86a5-024ac04f2f58 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:51.007731 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-f9e1dd97-48b8-4d78-86a5-024ac04f2f58 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:51.019641 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f9e1dd97-48b8-4d78-86a5-024ac04f2f58 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1267 microversion: 2.1 time: 0.219705 Jan 10 11:47:51.020244 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 558/1103] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:50 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:47:52.040817 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ba5cb430-10c2-4426-9c15-1862761a6855 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:52.041661 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ba5cb430-10c2-4426-9c15-1862761a6855 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:52.049039 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ba5cb430-10c2-4426-9c15-1862761a6855 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:52.061558 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ba5cb430-10c2-4426-9c15-1862761a6855 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:52.061558 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ba5cb430-10c2-4426-9c15-1862761a6855 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:52.061558 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ba5cb430-10c2-4426-9c15-1862761a6855 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:52.246513 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ba5cb430-10c2-4426-9c15-1862761a6855 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:52.256191 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ba5cb430-10c2-4426-9c15-1862761a6855 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1267 microversion: 2.1 time: 0.219272 Jan 10 11:47:52.256876 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 546/1104] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:52 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:53.281777 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7e6753df-d800-4ffb-a361-04203bf68180 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:53.282422 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7e6753df-d800-4ffb-a361-04203bf68180 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:53.289236 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7e6753df-d800-4ffb-a361-04203bf68180 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:53.289688 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7e6753df-d800-4ffb-a361-04203bf68180 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:53.290520 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7e6753df-d800-4ffb-a361-04203bf68180 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:53.290962 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7e6753df-d800-4ffb-a361-04203bf68180 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:53.434874 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-7e6753df-d800-4ffb-a361-04203bf68180 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:53.442325 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7e6753df-d800-4ffb-a361-04203bf68180 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1267 microversion: 2.1 time: 0.164603 Jan 10 11:47:53.442901 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 559/1105] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:53 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:54.459317 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-fbe27b7b-cba3-4e6b-9e2d-7283209c4d76 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:54.459917 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-fbe27b7b-cba3-4e6b-9e2d-7283209c4d76 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:54.467332 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fbe27b7b-cba3-4e6b-9e2d-7283209c4d76 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:54.467780 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fbe27b7b-cba3-4e6b-9e2d-7283209c4d76 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:54.468566 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fbe27b7b-cba3-4e6b-9e2d-7283209c4d76 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:54.469000 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-fbe27b7b-cba3-4e6b-9e2d-7283209c4d76 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:54.609753 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-fbe27b7b-cba3-4e6b-9e2d-7283209c4d76 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:54.617978 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-fbe27b7b-cba3-4e6b-9e2d-7283209c4d76 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1267 microversion: 2.1 time: 0.162543 Jan 10 11:47:54.618598 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 547/1106] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:54 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:55.637180 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-fdca4612-6e7b-4dbf-9ee4-6fa16d1d0ba7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:55.637997 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-fdca4612-6e7b-4dbf-9ee4-6fa16d1d0ba7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:55.658716 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fdca4612-6e7b-4dbf-9ee4-6fa16d1d0ba7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:55.659533 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fdca4612-6e7b-4dbf-9ee4-6fa16d1d0ba7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:55.661093 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fdca4612-6e7b-4dbf-9ee4-6fa16d1d0ba7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:55.661793 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fdca4612-6e7b-4dbf-9ee4-6fa16d1d0ba7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:55.839549 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-fdca4612-6e7b-4dbf-9ee4-6fa16d1d0ba7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:55.852566 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-fdca4612-6e7b-4dbf-9ee4-6fa16d1d0ba7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1267 microversion: 2.1 time: 0.219760 Jan 10 11:47:55.853632 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 560/1107] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:55 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:47:56.879260 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f46ec378-8dd8-4605-990a-92e4748c711d tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:56.879905 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f46ec378-8dd8-4605-990a-92e4748c711d tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:56.887302 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f46ec378-8dd8-4605-990a-92e4748c711d tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:56.887746 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f46ec378-8dd8-4605-990a-92e4748c711d tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:56.888547 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f46ec378-8dd8-4605-990a-92e4748c711d tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:56.888982 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f46ec378-8dd8-4605-990a-92e4748c711d tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:57.028638 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f46ec378-8dd8-4605-990a-92e4748c711d tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:57.036073 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f46ec378-8dd8-4605-990a-92e4748c711d tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1267 microversion: 2.1 time: 0.160448 Jan 10 11:47:57.036639 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 548/1108] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:56 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:47:57.619605 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-6e1006a8-9a01-4199-bb63-f34658432ed6 req-51234a1d-81ef-4380-a00b-6fca707367aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47fc785-2072-4e05-9f7b-f95dbc2757d2", "name": "network-vif-plugged", "status": "completed", "tag": "a39e281b-2b52-4b5d-b8e6-6a5a4222b744"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:47:57.627126 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:47:57.627126 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:47:57.629497 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-6e1006a8-9a01-4199-bb63-f34658432ed6 req-51234a1d-81ef-4380-a00b-6fca707367aa service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:57.629943 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-6e1006a8-9a01-4199-bb63-f34658432ed6 req-51234a1d-81ef-4380-a00b-6fca707367aa service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:57.643291 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-6e1006a8-9a01-4199-bb63-f34658432ed6 req-51234a1d-81ef-4380-a00b-6fca707367aa service nova] Creating event network-vif-plugged:a39e281b-2b52-4b5d-b8e6-6a5a4222b744 for instance c47fc785-2072-4e05-9f7b-f95dbc2757d2 on hv-cinder-maste Jan 10 11:47:57.649224 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-6e1006a8-9a01-4199-bb63-f34658432ed6 req-51234a1d-81ef-4380-a00b-6fca707367aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032981 Jan 10 11:47:57.649906 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 561/1109] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:47:58.053867 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-578b4801-c8a0-4d02-b164-c15fafb158b6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:58.054533 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-578b4801-c8a0-4d02-b164-c15fafb158b6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:58.061692 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-578b4801-c8a0-4d02-b164-c15fafb158b6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:58.062198 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-578b4801-c8a0-4d02-b164-c15fafb158b6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:58.063091 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-578b4801-c8a0-4d02-b164-c15fafb158b6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:58.063617 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-578b4801-c8a0-4d02-b164-c15fafb158b6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:58.203691 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-578b4801-c8a0-4d02-b164-c15fafb158b6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:58.212057 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-578b4801-c8a0-4d02-b164-c15fafb158b6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1267 microversion: 2.1 time: 0.162034 Jan 10 11:47:58.212748 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 549/1110] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:58 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:58.462803 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-17c6c713-5edf-4895-b5d9-3879ce576da5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:58.464515 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-17c6c713-5edf-4895-b5d9-3879ce576da5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:58.471280 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-17c6c713-5edf-4895-b5d9-3879ce576da5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:58.471737 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-17c6c713-5edf-4895-b5d9-3879ce576da5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:58.472560 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-17c6c713-5edf-4895-b5d9-3879ce576da5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:58.473007 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-17c6c713-5edf-4895-b5d9-3879ce576da5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:58.556698 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-17c6c713-5edf-4895-b5d9-3879ce576da5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lazy-loading 'services' on Instance uuid b5f5525f-cd23-4529-9e01-37d87411475c {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:47:58.841052 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-17c6c713-5edf-4895-b5d9-3879ce576da5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c/os-volume_attachments/a7593864-8079-4b68-91f5-4141cfef25fb" status: 202 len: 0 microversion: 2.1 time: 0.382354 Jan 10 11:47:58.842043 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 562/1111] 10.222.0.20 () {58 vars in 1415 bytes} [Mon Jan 10 11:47:58 2022] DELETE /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c/os-volume_attachments/a7593864-8079-4b68-91f5-4141cfef25fb => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 10 11:47:59.231294 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-b45735c1-af14-487f-889a-2057f1537754 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:59.231936 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-b45735c1-af14-487f-889a-2057f1537754 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:59.238744 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b45735c1-af14-487f-889a-2057f1537754 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:59.239192 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b45735c1-af14-487f-889a-2057f1537754 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:59.239993 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b45735c1-af14-487f-889a-2057f1537754 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:59.240427 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-b45735c1-af14-487f-889a-2057f1537754 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:59.405339 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-b45735c1-af14-487f-889a-2057f1537754 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:47:59.413117 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-b45735c1-af14-487f-889a-2057f1537754 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1267 microversion: 2.1 time: 0.186207 Jan 10 11:47:59.413700 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 550/1112] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:47:59 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:47:59.959877 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-fb1c0afa-4b81-44b8-aa45-b5669ad29c62 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:47:59.960528 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-fb1c0afa-4b81-44b8-aa45-b5669ad29c62 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:47:59.968019 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fb1c0afa-4b81-44b8-aa45-b5669ad29c62 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:59.968475 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fb1c0afa-4b81-44b8-aa45-b5669ad29c62 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:59.969285 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fb1c0afa-4b81-44b8-aa45-b5669ad29c62 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:47:59.969721 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-fb1c0afa-4b81-44b8-aa45-b5669ad29c62 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:47:59.998613 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-fb1c0afa-4b81-44b8-aa45-b5669ad29c62 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Going to try to terminate instance {{(pid=128719) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:48:00.430433 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-7e2331d4-aed3-485e-941a-cb9394eeeb63 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:48:00.431030 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-7e2331d4-aed3-485e-941a-cb9394eeeb63 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:48:00.439113 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7e2331d4-aed3-485e-941a-cb9394eeeb63 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:48:00.439573 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7e2331d4-aed3-485e-941a-cb9394eeeb63 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:48:00.440374 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7e2331d4-aed3-485e-941a-cb9394eeeb63 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:48:00.440817 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-7e2331d4-aed3-485e-941a-cb9394eeeb63 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:48:00.447749 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-fb1c0afa-4b81-44b8-aa45-b5669ad29c62 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c" status: 204 len: 0 microversion: 2.1 time: 0.491132 Jan 10 11:48:00.448359 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 563/1113] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:47:59 2022] DELETE /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:48:00.457393 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-865edcae-bb5a-4482-aa2e-0a233080d245 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:48:00.463584 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-865edcae-bb5a-4482-aa2e-0a233080d245 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:48:00.464845 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-865edcae-bb5a-4482-aa2e-0a233080d245 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:48:00.465296 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-865edcae-bb5a-4482-aa2e-0a233080d245 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:48:00.466109 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-865edcae-bb5a-4482-aa2e-0a233080d245 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:48:00.466576 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-865edcae-bb5a-4482-aa2e-0a233080d245 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:48:00.680716 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-7e2331d4-aed3-485e-941a-cb9394eeeb63 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:48:00.683760 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-865edcae-bb5a-4482-aa2e-0a233080d245 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:48:00.691598 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-865edcae-bb5a-4482-aa2e-0a233080d245 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c" status: 200 len: 1515 microversion: 2.1 time: 0.238224 Jan 10 11:48:00.692302 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 564/1114] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:48:00 2022] GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c => generated 1515 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:48:00.692599 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-7e2331d4-aed3-485e-941a-cb9394eeeb63 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1453 microversion: 2.1 time: 0.265609 Jan 10 11:48:00.693706 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 551/1115] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:48:00 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1453 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:48:00.710396 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2cacd010-bfc1-4ca7-8c17-8294c9a82bf5 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:48:00.711017 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2cacd010-bfc1-4ca7-8c17-8294c9a82bf5 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:48:00.718313 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2cacd010-bfc1-4ca7-8c17-8294c9a82bf5 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:48:00.718784 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2cacd010-bfc1-4ca7-8c17-8294c9a82bf5 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:48:00.719593 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2cacd010-bfc1-4ca7-8c17-8294c9a82bf5 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:48:00.720031 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2cacd010-bfc1-4ca7-8c17-8294c9a82bf5 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:48:00.891638 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2cacd010-bfc1-4ca7-8c17-8294c9a82bf5 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:48:00.899035 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2cacd010-bfc1-4ca7-8c17-8294c9a82bf5 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1453 microversion: 2.1 time: 0.192421 Jan 10 11:48:00.899628 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 565/1116] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:48:00 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1453 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:48:01.711753 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-58e494cd-f0be-4ac5-9586-0e2f864a1674 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:48:01.712923 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-58e494cd-f0be-4ac5-9586-0e2f864a1674 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:48:01.720149 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-58e494cd-f0be-4ac5-9586-0e2f864a1674 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:48:01.721094 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-58e494cd-f0be-4ac5-9586-0e2f864a1674 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:48:01.721953 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-58e494cd-f0be-4ac5-9586-0e2f864a1674 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:48:01.722419 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-58e494cd-f0be-4ac5-9586-0e2f864a1674 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:48:02.004831 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-58e494cd-f0be-4ac5-9586-0e2f864a1674 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:48:02.015186 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-58e494cd-f0be-4ac5-9586-0e2f864a1674 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c" status: 200 len: 1515 microversion: 2.1 time: 0.307719 Jan 10 11:48:02.028595 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 552/1117] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:48:01 2022] GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c => generated 1515 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:48:02.693073 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-d2de0859-b6ce-468c-a3db-d082d6464a8f req-48dbc0a6-cebd-4ea2-b9c7-edfd85730b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5f5525f-cd23-4529-9e01-37d87411475c", "name": "network-vif-deleted", "tag": "cbc9ee38-826b-44c2-9204-d3f7474dbf8c"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:48:02.695772 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:48:02.695772 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:48:02.708117 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-d2de0859-b6ce-468c-a3db-d082d6464a8f req-48dbc0a6-cebd-4ea2-b9c7-edfd85730b3d service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:48:02.709026 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-d2de0859-b6ce-468c-a3db-d082d6464a8f req-48dbc0a6-cebd-4ea2-b9c7-edfd85730b3d service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:48:02.724137 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-d2de0859-b6ce-468c-a3db-d082d6464a8f req-48dbc0a6-cebd-4ea2-b9c7-edfd85730b3d service nova] Creating event network-vif-deleted:cbc9ee38-826b-44c2-9204-d3f7474dbf8c for instance b5f5525f-cd23-4529-9e01-37d87411475c on hv-cinder-maste Jan 10 11:48:02.730852 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-d2de0859-b6ce-468c-a3db-d082d6464a8f req-48dbc0a6-cebd-4ea2-b9c7-edfd85730b3d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041483 Jan 10 11:48:02.731473 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 566/1118] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:48:03.036242 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-478eaedb-e587-4e4f-8bd3-863bec5582a5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:48:03.036905 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-478eaedb-e587-4e4f-8bd3-863bec5582a5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:48:03.045425 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-478eaedb-e587-4e4f-8bd3-863bec5582a5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:48:03.045893 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-478eaedb-e587-4e4f-8bd3-863bec5582a5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:48:03.046796 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-478eaedb-e587-4e4f-8bd3-863bec5582a5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:48:03.047255 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-478eaedb-e587-4e4f-8bd3-863bec5582a5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:48:03.085584 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-478eaedb-e587-4e4f-8bd3-863bec5582a5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:48:03.086040 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-478eaedb-e587-4e4f-8bd3-863bec5582a5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:48:03.086550 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.objects.instance [None req-478eaedb-e587-4e4f-8bd3-863bec5582a5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lazy-loading 'fault' on Instance uuid b5f5525f-cd23-4529-9e01-37d87411475c {{(pid=128718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:48:03.275852 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-478eaedb-e587-4e4f-8bd3-863bec5582a5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '170dcc817fa34bc781ffe7fedf729b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77459867f2ca40c6aac9eebdcfed7ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:48:03.283368 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-478eaedb-e587-4e4f-8bd3-863bec5582a5 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c" status: 200 len: 1309 microversion: 2.1 time: 0.250875 Jan 10 11:48:03.283959 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 553/1119] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:48:03 2022] GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c => generated 1309 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:48:03.648987 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-cd3233f4-36e3-40bc-aeca-667fba25c38e req-333ecc42-ae62-482c-a97e-acf6068056a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c47fc785-2072-4e05-9f7b-f95dbc2757d2", "tag": "a39e281b-2b52-4b5d-b8e6-6a5a4222b744"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:48:03.652126 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:48:03.652126 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:48:03.660234 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-cd3233f4-36e3-40bc-aeca-667fba25c38e req-333ecc42-ae62-482c-a97e-acf6068056a7 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:48:03.660866 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-cd3233f4-36e3-40bc-aeca-667fba25c38e req-333ecc42-ae62-482c-a97e-acf6068056a7 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:48:03.674000 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-cd3233f4-36e3-40bc-aeca-667fba25c38e req-333ecc42-ae62-482c-a97e-acf6068056a7 service nova] Creating event network-changed:a39e281b-2b52-4b5d-b8e6-6a5a4222b744 for instance c47fc785-2072-4e05-9f7b-f95dbc2757d2 on hv-cinder-maste Jan 10 11:48:03.680195 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-cd3233f4-36e3-40bc-aeca-667fba25c38e req-333ecc42-ae62-482c-a97e-acf6068056a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035496 Jan 10 11:48:03.680842 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 567/1120] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:48:04.306832 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-285fb45d-0be6-4be2-bf0e-89889de298e9 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:48:04.307944 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-285fb45d-0be6-4be2-bf0e-89889de298e9 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] [instance: b5f5525f-cd23-4529-9e01-37d87411475c] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:48:04.321644 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-285fb45d-0be6-4be2-bf0e-89889de298e9 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:48:04.322712 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-285fb45d-0be6-4be2-bf0e-89889de298e9 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:48:04.323788 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-285fb45d-0be6-4be2-bf0e-89889de298e9 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:48:04.324437 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-285fb45d-0be6-4be2-bf0e-89889de298e9 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:48:04.342101 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-285fb45d-0be6-4be2-bf0e-89889de298e9 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] HTTP exception thrown: Instance b5f5525f-cd23-4529-9e01-37d87411475c could not be found. Jan 10 11:48:04.342950 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-285fb45d-0be6-4be2-bf0e-89889de298e9 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] Returning 404 to user: Instance b5f5525f-cd23-4529-9e01-37d87411475c could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:48:04.343985 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-285fb45d-0be6-4be2-bf0e-89889de298e9 tempest-VolumesSnapshotTestJSON-1071101673 tempest-VolumesSnapshotTestJSON-1071101673-project] 10.222.0.20 "GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c" status: 404 len: 111 microversion: 2.1 time: 0.046305 Jan 10 11:48:04.344720 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 554/1121] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:48:04 2022] GET /compute/v2.1/servers/b5f5525f-cd23-4529-9e01-37d87411475c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:48:19.011304 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 11:48:19.052625 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: Mon Jan 10 11:48:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 11:49:10.871990 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 11:49:10.872579 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: Mon Jan 10 11:49:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 11:49:58.939023 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: ERROR oslo.messaging._drivers.impl_rabbit [-] [074f29cf-6874-4a00-a5e7-9c7cded45330] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jan 10 11:49:58.943029 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-462f60b7-566d-40ee-9e7a-aca2170a51d0 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:49:58.943622 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-462f60b7-566d-40ee-9e7a-aca2170a51d0 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:49:58.950012 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-462f60b7-566d-40ee-9e7a-aca2170a51d0 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:49:58.950596 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-462f60b7-566d-40ee-9e7a-aca2170a51d0 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:49:58.951299 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-462f60b7-566d-40ee-9e7a-aca2170a51d0 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:49:58.951740 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-462f60b7-566d-40ee-9e7a-aca2170a51d0 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:49:58.980614 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-462f60b7-566d-40ee-9e7a-aca2170a51d0 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Going to try to terminate instance {{(pid=128719) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:49:59.346221 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-462f60b7-566d-40ee-9e7a-aca2170a51d0 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 204 len: 0 microversion: 2.1 time: 0.408921 Jan 10 11:49:59.346821 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 568/1122] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:49:58 2022] DELETE /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:49:59.358547 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4bafb026-1815-466c-ac28-c6713801aaf8 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:49:59.363774 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4bafb026-1815-466c-ac28-c6713801aaf8 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:49:59.365674 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4bafb026-1815-466c-ac28-c6713801aaf8 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:49:59.366127 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4bafb026-1815-466c-ac28-c6713801aaf8 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:49:59.366940 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4bafb026-1815-466c-ac28-c6713801aaf8 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:49:59.368005 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4bafb026-1815-466c-ac28-c6713801aaf8 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:49:59.515251 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4bafb026-1815-466c-ac28-c6713801aaf8 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:49:59.522922 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4bafb026-1815-466c-ac28-c6713801aaf8 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1577 microversion: 2.1 time: 0.171745 Jan 10 11:49:59.523484 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 555/1123] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:49:59 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:00.542488 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e99716e5-182c-457a-83b0-faef5ce77440 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:00.543194 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-e99716e5-182c-457a-83b0-faef5ce77440 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:00.550241 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e99716e5-182c-457a-83b0-faef5ce77440 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:00.550696 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e99716e5-182c-457a-83b0-faef5ce77440 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:00.551475 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e99716e5-182c-457a-83b0-faef5ce77440 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:00.551928 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e99716e5-182c-457a-83b0-faef5ce77440 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:00.557965 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO oslo.messaging._drivers.impl_rabbit [-] [074f29cf-6874-4a00-a5e7-9c7cded45330] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60420. Jan 10 11:50:00.685800 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-e99716e5-182c-457a-83b0-faef5ce77440 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:00.693250 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-e99716e5-182c-457a-83b0-faef5ce77440 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1577 microversion: 2.1 time: 0.156060 Jan 10 11:50:00.698590 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 569/1124] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:00 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:01.711714 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-895e04a8-6846-40fa-8566-d14bd96d4f54 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:01.712487 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-895e04a8-6846-40fa-8566-d14bd96d4f54 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:01.719851 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-895e04a8-6846-40fa-8566-d14bd96d4f54 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:01.724890 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-895e04a8-6846-40fa-8566-d14bd96d4f54 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:01.724890 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-895e04a8-6846-40fa-8566-d14bd96d4f54 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:01.724890 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-895e04a8-6846-40fa-8566-d14bd96d4f54 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:01.788271 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-895e04a8-6846-40fa-8566-d14bd96d4f54 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:01.796968 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-895e04a8-6846-40fa-8566-d14bd96d4f54 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1509 microversion: 2.1 time: 0.089418 Jan 10 11:50:01.797562 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 556/1125] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:01 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1509 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:02.075849 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-7f1224e7-69d3-4fe4-8723-9f7bfc44f58e req-9e303e28-b8a9-4dfe-bb7c-58b9a235899b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47fc785-2072-4e05-9f7b-f95dbc2757d2", "name": "network-vif-deleted", "tag": "a39e281b-2b52-4b5d-b8e6-6a5a4222b744"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:50:02.087701 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:50:02.087701 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:50:02.099460 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-7f1224e7-69d3-4fe4-8723-9f7bfc44f58e req-9e303e28-b8a9-4dfe-bb7c-58b9a235899b service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:02.099906 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-7f1224e7-69d3-4fe4-8723-9f7bfc44f58e req-9e303e28-b8a9-4dfe-bb7c-58b9a235899b service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:02.112815 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-7f1224e7-69d3-4fe4-8723-9f7bfc44f58e req-9e303e28-b8a9-4dfe-bb7c-58b9a235899b service nova] Creating event network-vif-deleted:a39e281b-2b52-4b5d-b8e6-6a5a4222b744 for instance c47fc785-2072-4e05-9f7b-f95dbc2757d2 on hv-cinder-maste Jan 10 11:50:02.118644 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-7f1224e7-69d3-4fe4-8723-9f7bfc44f58e req-9e303e28-b8a9-4dfe-bb7c-58b9a235899b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.258457 Jan 10 11:50:02.119252 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 570/1126] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:50:02.815344 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0e820676-c392-489e-84c3-4ce8e5378f16 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:02.815954 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0e820676-c392-489e-84c3-4ce8e5378f16 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:02.823860 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e820676-c392-489e-84c3-4ce8e5378f16 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:02.829800 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e820676-c392-489e-84c3-4ce8e5378f16 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:02.829800 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e820676-c392-489e-84c3-4ce8e5378f16 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:02.829800 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e820676-c392-489e-84c3-4ce8e5378f16 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:02.861968 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e820676-c392-489e-84c3-4ce8e5378f16 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:02.862645 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0e820676-c392-489e-84c3-4ce8e5378f16 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:02.881365 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.objects.instance [None req-0e820676-c392-489e-84c3-4ce8e5378f16 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lazy-loading 'fault' on Instance uuid c47fc785-2072-4e05-9f7b-f95dbc2757d2 {{(pid=128718) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:50:02.908140 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0e820676-c392-489e-84c3-4ce8e5378f16 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:02.916171 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0e820676-c392-489e-84c3-4ce8e5378f16 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 200 len: 1231 microversion: 2.1 time: 0.104463 Jan 10 11:50:02.916756 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 557/1127] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:02 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 1231 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:03.934151 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-820fc701-2d5c-413f-9c8b-83d094c574dc tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:03.934932 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-820fc701-2d5c-413f-9c8b-83d094c574dc tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:03.941693 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-820fc701-2d5c-413f-9c8b-83d094c574dc tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:03.941693 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-820fc701-2d5c-413f-9c8b-83d094c574dc tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:03.942604 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-820fc701-2d5c-413f-9c8b-83d094c574dc tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:03.942862 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-820fc701-2d5c-413f-9c8b-83d094c574dc tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:03.957275 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-820fc701-2d5c-413f-9c8b-83d094c574dc tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] HTTP exception thrown: Instance c47fc785-2072-4e05-9f7b-f95dbc2757d2 could not be found. Jan 10 11:50:03.957957 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-820fc701-2d5c-413f-9c8b-83d094c574dc tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Returning 404 to user: Instance c47fc785-2072-4e05-9f7b-f95dbc2757d2 could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:50:03.958832 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-820fc701-2d5c-413f-9c8b-83d094c574dc tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 404 len: 111 microversion: 2.1 time: 0.029610 Jan 10 11:50:03.959386 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 571/1128] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:03 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:50:04.056195 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-a2907f6d-8cb0-45ef-911c-07a66750836b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1125959409", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1006001352", "security_groups": [{"name": "tempest-secgroup-smoke-1361997568"}], "block_device_mapping_v2": [{"uuid": "58108d6a-9c6b-43b0-999d-ceb6bc81fbb4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "92f5a063-7815-44d4-b602-8402ae90a4bb"}]}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:50:04.174521 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.network.neutron [None req-a2907f6d-8cb0-45ef-911c-07a66750836b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] validate_networks() for [('92f5a063-7815-44d4-b602-8402ae90a4bb', None, None, None, None, None)] {{(pid=128718) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:50:04.561937 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-a2907f6d-8cb0-45ef-911c-07a66750836b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Flavor limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:50:04.562408 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-a2907f6d-8cb0-45ef-911c-07a66750836b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Image limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:50:04.562888 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-a2907f6d-8cb0-45ef-911c-07a66750836b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Flavor pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:50:04.563303 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-a2907f6d-8cb0-45ef-911c-07a66750836b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Image pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:50:04.563747 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-a2907f6d-8cb0-45ef-911c-07a66750836b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:50:04.573694 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a2907f6d-8cb0-45ef-911c-07a66750836b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:04.574141 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a2907f6d-8cb0-45ef-911c-07a66750836b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:04.575079 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a2907f6d-8cb0-45ef-911c-07a66750836b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:04.575660 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-a2907f6d-8cb0-45ef-911c-07a66750836b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:04.592780 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-a2907f6d-8cb0-45ef-911c-07a66750836b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Getting quotas for project 3f1d77884a2a4a7ebb85ba71e9d864a7. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:50:04.596927 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-a2907f6d-8cb0-45ef-911c-07a66750836b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Getting quotas for user fa0eed1277c2418ca9f815589ab58896 and project 3f1d77884a2a4a7ebb85ba71e9d864a7. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:50:04.655240 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a2907f6d-8cb0-45ef-911c-07a66750836b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Going to run 1 instances... {{(pid=128718) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:50:04.657578 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-a2907f6d-8cb0-45ef-911c-07a66750836b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='58108d6a-9c6b-43b0-999d-ceb6bc81fbb4',volume_size=None,volume_type=None)] {{(pid=128718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:50:05.274264 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-a2907f6d-8cb0-45ef-911c-07a66750836b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.221978 Jan 10 11:50:05.275216 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 558/1129] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:50:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 10 11:50:05.285246 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f1549519-450b-4ca2-88d1-f7ae4427a1aa tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:05.286054 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f1549519-450b-4ca2-88d1-f7ae4427a1aa tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:05.347030 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-f1549519-450b-4ca2-88d1-f7ae4427a1aa tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:05.355837 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f1549519-450b-4ca2-88d1-f7ae4427a1aa tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1095 microversion: 2.1 time: 0.074418 Jan 10 11:50:05.356325 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 572/1130] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:05 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:06.372914 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-36c85d64-5a8b-428c-807e-26fefba6e495 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:06.373612 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-36c85d64-5a8b-428c-807e-26fefba6e495 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:06.427323 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-36c85d64-5a8b-428c-807e-26fefba6e495 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:06.434414 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-36c85d64-5a8b-428c-807e-26fefba6e495 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1095 microversion: 2.1 time: 0.065700 Jan 10 11:50:06.434999 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 559/1131] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:06 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:50:07.451097 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-64327aa1-3f6b-4066-8bfc-135c2b7e03e4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:07.451847 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-64327aa1-3f6b-4066-8bfc-135c2b7e03e4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:07.458895 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-64327aa1-3f6b-4066-8bfc-135c2b7e03e4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:07.459350 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-64327aa1-3f6b-4066-8bfc-135c2b7e03e4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:07.460175 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-64327aa1-3f6b-4066-8bfc-135c2b7e03e4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:07.461156 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-64327aa1-3f6b-4066-8bfc-135c2b7e03e4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:07.531545 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-64327aa1-3f6b-4066-8bfc-135c2b7e03e4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:07.544681 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-64327aa1-3f6b-4066-8bfc-135c2b7e03e4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1193 microversion: 2.1 time: 0.096943 Jan 10 11:50:07.550638 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 573/1132] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:07 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:08.567905 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-110066f6-abd7-466f-ae0c-9fe5468f0065 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:08.567905 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-110066f6-abd7-466f-ae0c-9fe5468f0065 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:08.579563 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-110066f6-abd7-466f-ae0c-9fe5468f0065 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:08.580370 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-110066f6-abd7-466f-ae0c-9fe5468f0065 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:08.581824 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-110066f6-abd7-466f-ae0c-9fe5468f0065 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:08.582666 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-110066f6-abd7-466f-ae0c-9fe5468f0065 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:08.808721 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-110066f6-abd7-466f-ae0c-9fe5468f0065 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:08.820832 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-110066f6-abd7-466f-ae0c-9fe5468f0065 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1279 microversion: 2.1 time: 0.261371 Jan 10 11:50:08.822183 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 560/1133] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:08 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1279 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:09.796569 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-a6eef2f9-95ff-4412-ac44-6b6645e518bb req-40dfc391-66a2-4208-8a39-0c25068f316e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e70ae1e1-53e5-4a32-9632-bbdbf5be7231", "tag": "16ca642f-40bb-46ee-bbb7-62b2a82d1bf5"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:50:09.798351 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:50:09.798351 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:50:09.807337 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-a6eef2f9-95ff-4412-ac44-6b6645e518bb req-40dfc391-66a2-4208-8a39-0c25068f316e service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:09.807781 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-a6eef2f9-95ff-4412-ac44-6b6645e518bb req-40dfc391-66a2-4208-8a39-0c25068f316e service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:09.820837 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-a6eef2f9-95ff-4412-ac44-6b6645e518bb req-40dfc391-66a2-4208-8a39-0c25068f316e service nova] Creating event network-changed:16ca642f-40bb-46ee-bbb7-62b2a82d1bf5 for instance e70ae1e1-53e5-4a32-9632-bbdbf5be7231 on hv-cinder-maste Jan 10 11:50:09.826485 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-a6eef2f9-95ff-4412-ac44-6b6645e518bb req-40dfc391-66a2-4208-8a39-0c25068f316e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033722 Jan 10 11:50:09.827636 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 574/1134] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:50:09.845290 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-bc6e07d3-589e-4721-95e6-5d4ab6346ff4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:09.845941 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-bc6e07d3-589e-4721-95e6-5d4ab6346ff4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:09.856921 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bc6e07d3-589e-4721-95e6-5d4ab6346ff4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:09.857564 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bc6e07d3-589e-4721-95e6-5d4ab6346ff4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:09.858401 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bc6e07d3-589e-4721-95e6-5d4ab6346ff4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:09.858846 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bc6e07d3-589e-4721-95e6-5d4ab6346ff4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:10.018969 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-bc6e07d3-589e-4721-95e6-5d4ab6346ff4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:10.027283 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-bc6e07d3-589e-4721-95e6-5d4ab6346ff4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1267 microversion: 2.1 time: 0.186473 Jan 10 11:50:10.027856 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 561/1135] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:09 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:11.046978 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7eae2586-9812-4fd2-bd0a-780f795ded96 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:11.047683 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7eae2586-9812-4fd2-bd0a-780f795ded96 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:11.054465 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7eae2586-9812-4fd2-bd0a-780f795ded96 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:11.054917 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7eae2586-9812-4fd2-bd0a-780f795ded96 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:11.055723 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7eae2586-9812-4fd2-bd0a-780f795ded96 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:11.056165 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7eae2586-9812-4fd2-bd0a-780f795ded96 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:11.198721 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-7eae2586-9812-4fd2-bd0a-780f795ded96 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:11.206331 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7eae2586-9812-4fd2-bd0a-780f795ded96 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1267 microversion: 2.1 time: 0.164035 Jan 10 11:50:11.206911 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 575/1136] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:11 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:12.223851 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-68876932-0239-4b71-8fe9-0c1d80197060 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:12.224458 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-68876932-0239-4b71-8fe9-0c1d80197060 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:12.231446 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-68876932-0239-4b71-8fe9-0c1d80197060 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:12.231899 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-68876932-0239-4b71-8fe9-0c1d80197060 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:12.232706 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-68876932-0239-4b71-8fe9-0c1d80197060 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:12.233146 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-68876932-0239-4b71-8fe9-0c1d80197060 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:12.383216 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-68876932-0239-4b71-8fe9-0c1d80197060 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:12.391081 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-68876932-0239-4b71-8fe9-0c1d80197060 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1267 microversion: 2.1 time: 0.170928 Jan 10 11:50:12.391689 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 562/1137] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:12 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:13.408682 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-4665603d-8642-4db1-8575-39420cfa6d13 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:13.409290 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-4665603d-8642-4db1-8575-39420cfa6d13 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:13.415842 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4665603d-8642-4db1-8575-39420cfa6d13 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:13.416330 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4665603d-8642-4db1-8575-39420cfa6d13 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:13.417118 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4665603d-8642-4db1-8575-39420cfa6d13 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:13.417553 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4665603d-8642-4db1-8575-39420cfa6d13 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:13.561976 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-4665603d-8642-4db1-8575-39420cfa6d13 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:13.570474 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-4665603d-8642-4db1-8575-39420cfa6d13 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1267 microversion: 2.1 time: 0.165293 Jan 10 11:50:13.571123 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 576/1138] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:13 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:14.587722 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-30ad44f6-8e40-430a-91d1-51eca0a9275e tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:14.588421 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-30ad44f6-8e40-430a-91d1-51eca0a9275e tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:14.595081 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-30ad44f6-8e40-430a-91d1-51eca0a9275e tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:14.595569 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-30ad44f6-8e40-430a-91d1-51eca0a9275e tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:14.596372 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-30ad44f6-8e40-430a-91d1-51eca0a9275e tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:14.596813 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-30ad44f6-8e40-430a-91d1-51eca0a9275e tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:14.739802 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-30ad44f6-8e40-430a-91d1-51eca0a9275e tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:14.748181 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-30ad44f6-8e40-430a-91d1-51eca0a9275e tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1267 microversion: 2.1 time: 0.164593 Jan 10 11:50:14.748766 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 563/1139] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:14 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:15.765349 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-58d6aa49-a22e-4c0d-9c3b-4c916d0067a2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:15.765939 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-58d6aa49-a22e-4c0d-9c3b-4c916d0067a2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:15.773705 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-58d6aa49-a22e-4c0d-9c3b-4c916d0067a2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:15.774245 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-58d6aa49-a22e-4c0d-9c3b-4c916d0067a2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:15.775135 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-58d6aa49-a22e-4c0d-9c3b-4c916d0067a2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:15.775657 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-58d6aa49-a22e-4c0d-9c3b-4c916d0067a2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:15.943917 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-58d6aa49-a22e-4c0d-9c3b-4c916d0067a2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:15.952972 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-58d6aa49-a22e-4c0d-9c3b-4c916d0067a2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1267 microversion: 2.1 time: 0.191686 Jan 10 11:50:15.953556 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 577/1140] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:15 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:16.970351 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-3744f86c-89f5-4bf8-923c-db89dc03b7a6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:16.970900 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-3744f86c-89f5-4bf8-923c-db89dc03b7a6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:16.977879 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3744f86c-89f5-4bf8-923c-db89dc03b7a6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:16.978425 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3744f86c-89f5-4bf8-923c-db89dc03b7a6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:16.979208 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3744f86c-89f5-4bf8-923c-db89dc03b7a6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:16.979647 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-3744f86c-89f5-4bf8-923c-db89dc03b7a6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:17.121229 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-3744f86c-89f5-4bf8-923c-db89dc03b7a6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:17.128724 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-3744f86c-89f5-4bf8-923c-db89dc03b7a6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1267 microversion: 2.1 time: 0.162092 Jan 10 11:50:17.129302 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 564/1141] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:16 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:18.144894 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-18bb77fb-a8c2-4dc1-a584-766b8c8b1c8b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:18.145514 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-18bb77fb-a8c2-4dc1-a584-766b8c8b1c8b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:18.152008 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-18bb77fb-a8c2-4dc1-a584-766b8c8b1c8b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:18.152460 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-18bb77fb-a8c2-4dc1-a584-766b8c8b1c8b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:18.153246 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-18bb77fb-a8c2-4dc1-a584-766b8c8b1c8b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:18.153682 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-18bb77fb-a8c2-4dc1-a584-766b8c8b1c8b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:18.290494 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-18bb77fb-a8c2-4dc1-a584-766b8c8b1c8b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:18.298016 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-18bb77fb-a8c2-4dc1-a584-766b8c8b1c8b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1267 microversion: 2.1 time: 0.156768 Jan 10 11:50:18.298613 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 578/1142] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:18 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:19.315401 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-1f1f552a-c648-4ed3-99b9-e650382b5bdf tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:19.316051 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-1f1f552a-c648-4ed3-99b9-e650382b5bdf tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:19.322666 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1f1f552a-c648-4ed3-99b9-e650382b5bdf tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:19.323296 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1f1f552a-c648-4ed3-99b9-e650382b5bdf tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:19.324103 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1f1f552a-c648-4ed3-99b9-e650382b5bdf tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:19.324547 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-1f1f552a-c648-4ed3-99b9-e650382b5bdf tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:19.465499 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-1f1f552a-c648-4ed3-99b9-e650382b5bdf tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:19.473173 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-1f1f552a-c648-4ed3-99b9-e650382b5bdf tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1267 microversion: 2.1 time: 0.161445 Jan 10 11:50:19.476666 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 565/1143] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:19 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:20.494068 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2e8cf2c2-f7b1-4cd3-bd34-042174057811 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:20.494941 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2e8cf2c2-f7b1-4cd3-bd34-042174057811 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:20.501829 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e8cf2c2-f7b1-4cd3-bd34-042174057811 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:20.502356 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e8cf2c2-f7b1-4cd3-bd34-042174057811 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:20.503149 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e8cf2c2-f7b1-4cd3-bd34-042174057811 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:20.503580 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2e8cf2c2-f7b1-4cd3-bd34-042174057811 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:20.645236 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2e8cf2c2-f7b1-4cd3-bd34-042174057811 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:20.653257 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2e8cf2c2-f7b1-4cd3-bd34-042174057811 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1267 microversion: 2.1 time: 0.164958 Jan 10 11:50:20.653854 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 579/1144] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:20 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:21.672212 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-89ea7332-5c3b-4322-a9f3-541e1b72c2a7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:21.673365 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-89ea7332-5c3b-4322-a9f3-541e1b72c2a7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:21.681476 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-89ea7332-5c3b-4322-a9f3-541e1b72c2a7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:21.681933 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-89ea7332-5c3b-4322-a9f3-541e1b72c2a7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:21.682763 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-89ea7332-5c3b-4322-a9f3-541e1b72c2a7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:21.683203 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-89ea7332-5c3b-4322-a9f3-541e1b72c2a7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:21.879363 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-89ea7332-5c3b-4322-a9f3-541e1b72c2a7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:21.893617 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-89ea7332-5c3b-4322-a9f3-541e1b72c2a7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1267 microversion: 2.1 time: 0.225626 Jan 10 11:50:21.894401 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 566/1145] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:21 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:21.926435 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-8911e80d-1735-44da-a0b1-a00f6b2cf53f req-6fe7806a-2e48-4156-a684-a454dbd09b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e70ae1e1-53e5-4a32-9632-bbdbf5be7231", "name": "network-vif-plugged", "status": "completed", "tag": "16ca642f-40bb-46ee-bbb7-62b2a82d1bf5"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:50:21.936274 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:50:21.936274 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:50:21.936829 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-8911e80d-1735-44da-a0b1-a00f6b2cf53f req-6fe7806a-2e48-4156-a684-a454dbd09b33 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:21.937285 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-8911e80d-1735-44da-a0b1-a00f6b2cf53f req-6fe7806a-2e48-4156-a684-a454dbd09b33 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:21.954876 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-8911e80d-1735-44da-a0b1-a00f6b2cf53f req-6fe7806a-2e48-4156-a684-a454dbd09b33 service nova] Creating event network-vif-plugged:16ca642f-40bb-46ee-bbb7-62b2a82d1bf5 for instance e70ae1e1-53e5-4a32-9632-bbdbf5be7231 on hv-cinder-maste Jan 10 11:50:21.961090 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-8911e80d-1735-44da-a0b1-a00f6b2cf53f req-6fe7806a-2e48-4156-a684-a454dbd09b33 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111518 Jan 10 11:50:21.962041 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 580/1146] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:50:22.911431 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-d9469618-7dbe-44d5-9eb8-d085dbcb3a7c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:22.912628 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-d9469618-7dbe-44d5-9eb8-d085dbcb3a7c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:22.919408 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d9469618-7dbe-44d5-9eb8-d085dbcb3a7c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:22.919860 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d9469618-7dbe-44d5-9eb8-d085dbcb3a7c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:22.920641 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d9469618-7dbe-44d5-9eb8-d085dbcb3a7c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:22.921077 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-d9469618-7dbe-44d5-9eb8-d085dbcb3a7c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:23.063359 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-d9469618-7dbe-44d5-9eb8-d085dbcb3a7c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:23.071903 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-d9469618-7dbe-44d5-9eb8-d085dbcb3a7c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1267 microversion: 2.1 time: 0.164569 Jan 10 11:50:23.072479 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 567/1147] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:22 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:24.089574 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-58c51285-89c8-47f4-8f9b-31735a8b45b2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:24.090325 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-58c51285-89c8-47f4-8f9b-31735a8b45b2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:24.096620 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-58c51285-89c8-47f4-8f9b-31735a8b45b2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:24.097075 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-58c51285-89c8-47f4-8f9b-31735a8b45b2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:24.097871 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-58c51285-89c8-47f4-8f9b-31735a8b45b2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:24.098353 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-58c51285-89c8-47f4-8f9b-31735a8b45b2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:24.245143 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-58c51285-89c8-47f4-8f9b-31735a8b45b2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:24.253453 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-58c51285-89c8-47f4-8f9b-31735a8b45b2 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1453 microversion: 2.1 time: 0.168574 Jan 10 11:50:24.254038 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 581/1148] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:24 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:24.281894 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-ef1dad12-4d25-43b0-8644-603324800bcb tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:50:24.283092 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-ef1dad12-4d25-43b0-8644-603324800bcb tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:50:24.293552 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ef1dad12-4d25-43b0-8644-603324800bcb tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:24.294334 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ef1dad12-4d25-43b0-8644-603324800bcb tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:24.295647 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ef1dad12-4d25-43b0-8644-603324800bcb tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:24.296102 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-ef1dad12-4d25-43b0-8644-603324800bcb tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:24.465680 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-ef1dad12-4d25-43b0-8644-603324800bcb tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:50:24.473542 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-ef1dad12-4d25-43b0-8644-603324800bcb tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1453 microversion: 2.1 time: 0.198833 Jan 10 11:50:24.474242 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 568/1149] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:50:24 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1453 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:50:26.973845 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-5c7c5c16-9308-42d9-a6ac-26b0fb8f4105 req-0bba76c0-dfaa-4de4-9c4d-6aee6ad9737d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e70ae1e1-53e5-4a32-9632-bbdbf5be7231", "tag": "16ca642f-40bb-46ee-bbb7-62b2a82d1bf5"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:50:26.975592 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:50:26.975592 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:50:26.983143 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-5c7c5c16-9308-42d9-a6ac-26b0fb8f4105 req-0bba76c0-dfaa-4de4-9c4d-6aee6ad9737d service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:50:26.983587 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-5c7c5c16-9308-42d9-a6ac-26b0fb8f4105 req-0bba76c0-dfaa-4de4-9c4d-6aee6ad9737d service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:50:26.996194 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-5c7c5c16-9308-42d9-a6ac-26b0fb8f4105 req-0bba76c0-dfaa-4de4-9c4d-6aee6ad9737d service nova] Creating event network-changed:16ca642f-40bb-46ee-bbb7-62b2a82d1bf5 for instance e70ae1e1-53e5-4a32-9632-bbdbf5be7231 on hv-cinder-maste Jan 10 11:50:27.001110 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-5c7c5c16-9308-42d9-a6ac-26b0fb8f4105 req-0bba76c0-dfaa-4de4-9c4d-6aee6ad9737d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123696 Jan 10 11:50:27.001800 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 582/1150] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:50:53.176378 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 11:50:53.177140 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: Mon Jan 10 11:50:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 11:51:39.019581 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 11:51:39.020388 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: Mon Jan 10 11:51:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 11:52:02.273892 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-6577228d-e7c4-484a-baf4-3db19ffd14d3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-206397321", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1006001352", "security_groups": [{"name": "tempest-secgroup-smoke-1361997568"}], "block_device_mapping_v2": [{"uuid": "a7258fb5-e191-4db0-9a69-709e0b70230c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "92f5a063-7815-44d4-b602-8402ae90a4bb"}]}} {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:52:02.391724 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.network.neutron [None req-6577228d-e7c4-484a-baf4-3db19ffd14d3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] validate_networks() for [('92f5a063-7815-44d4-b602-8402ae90a4bb', None, None, None, None, None)] {{(pid=128718) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 10 11:52:02.850851 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-6577228d-e7c4-484a-baf4-3db19ffd14d3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Flavor limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 10 11:52:02.851289 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-6577228d-e7c4-484a-baf4-3db19ffd14d3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Image limits 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 10 11:52:02.851772 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-6577228d-e7c4-484a-baf4-3db19ffd14d3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Flavor pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 10 11:52:02.852187 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-6577228d-e7c4-484a-baf4-3db19ffd14d3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Image pref 0:0:0 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 10 11:52:02.852681 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.virt.hardware [None req-6577228d-e7c4-484a-baf4-3db19ffd14d3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128718) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 10 11:52:02.862669 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6577228d-e7c4-484a-baf4-3db19ffd14d3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:02.863149 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6577228d-e7c4-484a-baf4-3db19ffd14d3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:02.863986 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6577228d-e7c4-484a-baf4-3db19ffd14d3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:02.864426 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-6577228d-e7c4-484a-baf4-3db19ffd14d3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:02.886874 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-6577228d-e7c4-484a-baf4-3db19ffd14d3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Getting quotas for project 3f1d77884a2a4a7ebb85ba71e9d864a7. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 10 11:52:02.891675 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.quota [None req-6577228d-e7c4-484a-baf4-3db19ffd14d3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Getting quotas for user fa0eed1277c2418ca9f815589ab58896 and project 3f1d77884a2a4a7ebb85ba71e9d864a7. Resources: {'cores', 'ram', 'instances'} {{(pid=128718) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 10 11:52:02.955875 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-6577228d-e7c4-484a-baf4-3db19ffd14d3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Going to run 1 instances... {{(pid=128718) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 10 11:52:02.957928 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-6577228d-e7c4-484a-baf4-3db19ffd14d3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a7258fb5-e191-4db0-9a69-709e0b70230c',volume_size=None,volume_type=None)] {{(pid=128718) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 10 11:52:03.489635 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-6577228d-e7c4-484a-baf4-3db19ffd14d3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.220225 Jan 10 11:52:03.490587 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 569/1151] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Jan 10 11:52:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 10 11:52:03.499534 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: ERROR oslo.messaging._drivers.impl_rabbit [-] [074f29cf-6874-4a00-a5e7-9c7cded45330] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jan 10 11:52:03.504764 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7f91eec2-e47d-4776-9497-70c0087f3ab3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:03.504764 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7f91eec2-e47d-4776-9497-70c0087f3ab3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:03.561865 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-7f91eec2-e47d-4776-9497-70c0087f3ab3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:03.569284 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7f91eec2-e47d-4776-9497-70c0087f3ab3 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1094 microversion: 2.1 time: 0.072378 Jan 10 11:52:03.569862 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 583/1152] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:03 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:52:04.587429 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-df6087af-60ba-4def-9ac9-746223fb1ec7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:04.588049 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-df6087af-60ba-4def-9ac9-746223fb1ec7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:04.596125 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-df6087af-60ba-4def-9ac9-746223fb1ec7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:04.596808 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-df6087af-60ba-4def-9ac9-746223fb1ec7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:04.598047 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-df6087af-60ba-4def-9ac9-746223fb1ec7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:04.598844 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-df6087af-60ba-4def-9ac9-746223fb1ec7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:04.674868 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-df6087af-60ba-4def-9ac9-746223fb1ec7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:04.682549 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-df6087af-60ba-4def-9ac9-746223fb1ec7 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1144 microversion: 2.1 time: 0.099458 Jan 10 11:52:04.683125 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 570/1153] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:04 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1144 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:52:05.701447 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-05fccf7c-b2de-4afd-8b29-9008122237c4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:05.702131 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-05fccf7c-b2de-4afd-8b29-9008122237c4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:05.710774 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-05fccf7c-b2de-4afd-8b29-9008122237c4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:05.711226 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-05fccf7c-b2de-4afd-8b29-9008122237c4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:05.712015 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-05fccf7c-b2de-4afd-8b29-9008122237c4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:05.712455 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-05fccf7c-b2de-4afd-8b29-9008122237c4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:05.728284 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO oslo.messaging._drivers.impl_rabbit [-] [074f29cf-6874-4a00-a5e7-9c7cded45330] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 60602. Jan 10 11:52:05.774952 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-05fccf7c-b2de-4afd-8b29-9008122237c4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:05.783600 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-05fccf7c-b2de-4afd-8b29-9008122237c4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1192 microversion: 2.1 time: 0.086690 Jan 10 11:52:05.784179 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 584/1154] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:05 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:52:06.802781 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0912f42b-ba4e-462d-ad94-f51c87d35cb4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:06.807179 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0912f42b-ba4e-462d-ad94-f51c87d35cb4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:06.815385 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0912f42b-ba4e-462d-ad94-f51c87d35cb4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:06.815385 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0912f42b-ba4e-462d-ad94-f51c87d35cb4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:06.815385 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0912f42b-ba4e-462d-ad94-f51c87d35cb4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:06.815385 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0912f42b-ba4e-462d-ad94-f51c87d35cb4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:06.973916 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0912f42b-ba4e-462d-ad94-f51c87d35cb4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:06.982040 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0912f42b-ba4e-462d-ad94-f51c87d35cb4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1278 microversion: 2.1 time: 0.183629 Jan 10 11:52:06.982670 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 571/1155] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:06 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:52:07.975969 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-62d4797b-1f85-4af8-b206-1efe35a3a4a7 req-e2abd3f4-8d69-419d-b8dc-db30958e741d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8bfb8c4-46a9-45ba-84df-68560e051224", "tag": "521c1d4b-4729-4ac8-88a0-48f20ea6c44d"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:52:07.976543 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:52:07.976543 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:52:07.987861 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-62d4797b-1f85-4af8-b206-1efe35a3a4a7 req-e2abd3f4-8d69-419d-b8dc-db30958e741d service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:07.988490 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-62d4797b-1f85-4af8-b206-1efe35a3a4a7 req-e2abd3f4-8d69-419d-b8dc-db30958e741d service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:08.003952 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4cc8b113-9b0c-48af-a42e-0c506b2c63fe tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:08.005022 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4cc8b113-9b0c-48af-a42e-0c506b2c63fe tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:08.008834 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-62d4797b-1f85-4af8-b206-1efe35a3a4a7 req-e2abd3f4-8d69-419d-b8dc-db30958e741d service nova] Creating event network-changed:521c1d4b-4729-4ac8-88a0-48f20ea6c44d for instance d8bfb8c4-46a9-45ba-84df-68560e051224 on hv-cinder-maste Jan 10 11:52:08.016718 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4cc8b113-9b0c-48af-a42e-0c506b2c63fe tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:08.017028 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-62d4797b-1f85-4af8-b206-1efe35a3a4a7 req-e2abd3f4-8d69-419d-b8dc-db30958e741d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051796 Jan 10 11:52:08.017506 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4cc8b113-9b0c-48af-a42e-0c506b2c63fe tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:08.021635 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 585/1156] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:52:08.023257 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4cc8b113-9b0c-48af-a42e-0c506b2c63fe tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:08.024276 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4cc8b113-9b0c-48af-a42e-0c506b2c63fe tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:08.248617 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-4cc8b113-9b0c-48af-a42e-0c506b2c63fe tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:08.258187 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4cc8b113-9b0c-48af-a42e-0c506b2c63fe tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1266 microversion: 2.1 time: 0.261731 Jan 10 11:52:08.259029 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 572/1157] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:07 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:52:09.284774 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-c81d6dd0-19bd-4a15-a83d-831b1a479f58 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:09.285652 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-c81d6dd0-19bd-4a15-a83d-831b1a479f58 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:09.292842 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c81d6dd0-19bd-4a15-a83d-831b1a479f58 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:09.293384 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c81d6dd0-19bd-4a15-a83d-831b1a479f58 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:09.294289 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c81d6dd0-19bd-4a15-a83d-831b1a479f58 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:09.294786 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-c81d6dd0-19bd-4a15-a83d-831b1a479f58 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:09.462402 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-c81d6dd0-19bd-4a15-a83d-831b1a479f58 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:09.471364 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-c81d6dd0-19bd-4a15-a83d-831b1a479f58 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1266 microversion: 2.1 time: 0.190661 Jan 10 11:52:09.471968 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 586/1158] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:09 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:52:10.487935 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-f56d41f6-08fa-4ca7-90b1-c596678c5f14 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:10.488554 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-f56d41f6-08fa-4ca7-90b1-c596678c5f14 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:10.494958 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f56d41f6-08fa-4ca7-90b1-c596678c5f14 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:10.495416 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f56d41f6-08fa-4ca7-90b1-c596678c5f14 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:10.496207 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f56d41f6-08fa-4ca7-90b1-c596678c5f14 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:10.496837 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-f56d41f6-08fa-4ca7-90b1-c596678c5f14 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:10.642552 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-f56d41f6-08fa-4ca7-90b1-c596678c5f14 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:10.653828 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-f56d41f6-08fa-4ca7-90b1-c596678c5f14 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1266 microversion: 2.1 time: 0.168537 Jan 10 11:52:10.654456 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 573/1159] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:10 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:52:11.670926 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-2ae1a1d1-5476-47af-bbaa-025c816ea2a4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:11.671550 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-2ae1a1d1-5476-47af-bbaa-025c816ea2a4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:11.678160 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2ae1a1d1-5476-47af-bbaa-025c816ea2a4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:11.678672 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2ae1a1d1-5476-47af-bbaa-025c816ea2a4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:11.679451 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2ae1a1d1-5476-47af-bbaa-025c816ea2a4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:11.679898 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-2ae1a1d1-5476-47af-bbaa-025c816ea2a4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:11.841862 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-2ae1a1d1-5476-47af-bbaa-025c816ea2a4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:11.849955 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-2ae1a1d1-5476-47af-bbaa-025c816ea2a4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1266 microversion: 2.1 time: 0.182678 Jan 10 11:52:11.850581 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 587/1160] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:11 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:52:12.868610 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c96d2a1c-2883-4ca7-b68c-3cd3b1a7509e tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:12.869413 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c96d2a1c-2883-4ca7-b68c-3cd3b1a7509e tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:12.876258 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c96d2a1c-2883-4ca7-b68c-3cd3b1a7509e tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:12.876725 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c96d2a1c-2883-4ca7-b68c-3cd3b1a7509e tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:12.877532 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c96d2a1c-2883-4ca7-b68c-3cd3b1a7509e tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:12.877976 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c96d2a1c-2883-4ca7-b68c-3cd3b1a7509e tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:13.021146 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c96d2a1c-2883-4ca7-b68c-3cd3b1a7509e tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:13.028881 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c96d2a1c-2883-4ca7-b68c-3cd3b1a7509e tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1266 microversion: 2.1 time: 0.164073 Jan 10 11:52:13.029470 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 574/1161] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:12 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:52:14.103991 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-8a6e1d8d-7ac4-4ee8-9a96-3b4d00f758de tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:14.104656 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-8a6e1d8d-7ac4-4ee8-9a96-3b4d00f758de tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:14.111648 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8a6e1d8d-7ac4-4ee8-9a96-3b4d00f758de tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:14.112099 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8a6e1d8d-7ac4-4ee8-9a96-3b4d00f758de tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:14.112917 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8a6e1d8d-7ac4-4ee8-9a96-3b4d00f758de tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:14.113359 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-8a6e1d8d-7ac4-4ee8-9a96-3b4d00f758de tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:14.258779 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-8a6e1d8d-7ac4-4ee8-9a96-3b4d00f758de tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:14.267418 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-8a6e1d8d-7ac4-4ee8-9a96-3b4d00f758de tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1266 microversion: 2.1 time: 0.226101 Jan 10 11:52:14.268084 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 588/1162] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:14 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:52:15.284906 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-66b21ec2-8379-496b-946c-583fcfbe9ae1 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:15.285522 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-66b21ec2-8379-496b-946c-583fcfbe9ae1 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:15.292296 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-66b21ec2-8379-496b-946c-583fcfbe9ae1 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:15.292748 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-66b21ec2-8379-496b-946c-583fcfbe9ae1 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:15.294253 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-66b21ec2-8379-496b-946c-583fcfbe9ae1 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:15.294697 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-66b21ec2-8379-496b-946c-583fcfbe9ae1 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:15.442195 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-66b21ec2-8379-496b-946c-583fcfbe9ae1 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:15.450690 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-66b21ec2-8379-496b-946c-583fcfbe9ae1 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1266 microversion: 2.1 time: 0.169484 Jan 10 11:52:15.454886 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 575/1163] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:15 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:52:16.470011 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-6d3ea099-5e52-4afd-ac84-3195f1f2a8c4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:16.470705 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-6d3ea099-5e52-4afd-ac84-3195f1f2a8c4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:16.477046 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6d3ea099-5e52-4afd-ac84-3195f1f2a8c4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:16.477493 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6d3ea099-5e52-4afd-ac84-3195f1f2a8c4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:16.478294 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6d3ea099-5e52-4afd-ac84-3195f1f2a8c4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:16.478732 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-6d3ea099-5e52-4afd-ac84-3195f1f2a8c4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:16.613449 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-6d3ea099-5e52-4afd-ac84-3195f1f2a8c4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:16.623744 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-6d3ea099-5e52-4afd-ac84-3195f1f2a8c4 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1266 microversion: 2.1 time: 0.159151 Jan 10 11:52:16.624337 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 589/1164] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:16 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:52:17.640666 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-dd281685-9ab5-42a2-8265-2d324a0c744f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:17.641328 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-dd281685-9ab5-42a2-8265-2d324a0c744f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:17.647859 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dd281685-9ab5-42a2-8265-2d324a0c744f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:17.649898 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dd281685-9ab5-42a2-8265-2d324a0c744f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:17.649898 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dd281685-9ab5-42a2-8265-2d324a0c744f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:17.649898 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-dd281685-9ab5-42a2-8265-2d324a0c744f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:17.790395 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-dd281685-9ab5-42a2-8265-2d324a0c744f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:17.797883 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-dd281685-9ab5-42a2-8265-2d324a0c744f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1266 microversion: 2.1 time: 0.161104 Jan 10 11:52:17.798474 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 576/1165] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:17 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:52:18.814960 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7f7b8e8d-0ec6-4435-a872-5de02fa222a8 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:18.815582 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7f7b8e8d-0ec6-4435-a872-5de02fa222a8 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:18.822247 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7f7b8e8d-0ec6-4435-a872-5de02fa222a8 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:18.822704 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7f7b8e8d-0ec6-4435-a872-5de02fa222a8 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:18.823499 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7f7b8e8d-0ec6-4435-a872-5de02fa222a8 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:18.824002 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7f7b8e8d-0ec6-4435-a872-5de02fa222a8 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:18.984655 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-7f7b8e8d-0ec6-4435-a872-5de02fa222a8 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:18.992848 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7f7b8e8d-0ec6-4435-a872-5de02fa222a8 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1266 microversion: 2.1 time: 0.181322 Jan 10 11:52:18.993775 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 590/1166] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:18 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:52:20.012063 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-80028c30-97c9-4f30-b545-736a8116ffea tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:20.012685 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-80028c30-97c9-4f30-b545-736a8116ffea tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:20.020311 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-80028c30-97c9-4f30-b545-736a8116ffea tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:20.020857 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-80028c30-97c9-4f30-b545-736a8116ffea tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:20.021842 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-80028c30-97c9-4f30-b545-736a8116ffea tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:20.022367 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-80028c30-97c9-4f30-b545-736a8116ffea tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:20.162032 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-80028c30-97c9-4f30-b545-736a8116ffea tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:20.170726 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-80028c30-97c9-4f30-b545-736a8116ffea tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1266 microversion: 2.1 time: 0.162616 Jan 10 11:52:20.171286 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 577/1167] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:20 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:52:20.351113 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-cb90dfd7-eeed-4724-8800-e0258250b93d req-ed34e396-eb71-4859-925c-ab3a095ebb8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8bfb8c4-46a9-45ba-84df-68560e051224", "name": "network-vif-plugged", "status": "completed", "tag": "521c1d4b-4729-4ac8-88a0-48f20ea6c44d"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:52:20.352665 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:52:20.352665 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:52:20.361000 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-cb90dfd7-eeed-4724-8800-e0258250b93d req-ed34e396-eb71-4859-925c-ab3a095ebb8a service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:20.361588 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-cb90dfd7-eeed-4724-8800-e0258250b93d req-ed34e396-eb71-4859-925c-ab3a095ebb8a service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:20.374244 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-cb90dfd7-eeed-4724-8800-e0258250b93d req-ed34e396-eb71-4859-925c-ab3a095ebb8a service nova] Creating event network-vif-plugged:521c1d4b-4729-4ac8-88a0-48f20ea6c44d for instance d8bfb8c4-46a9-45ba-84df-68560e051224 on hv-cinder-maste Jan 10 11:52:20.379539 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-cb90dfd7-eeed-4724-8800-e0258250b93d req-ed34e396-eb71-4859-925c-ab3a095ebb8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032137 Jan 10 11:52:20.380158 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 591/1168] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:52:21.190016 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-8f91a06f-ec44-45b6-b2e1-26c3fcfe3c3c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:21.190673 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-8f91a06f-ec44-45b6-b2e1-26c3fcfe3c3c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:21.197339 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8f91a06f-ec44-45b6-b2e1-26c3fcfe3c3c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:21.197792 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8f91a06f-ec44-45b6-b2e1-26c3fcfe3c3c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:21.198611 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8f91a06f-ec44-45b6-b2e1-26c3fcfe3c3c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:21.199390 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-8f91a06f-ec44-45b6-b2e1-26c3fcfe3c3c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:21.338857 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-8f91a06f-ec44-45b6-b2e1-26c3fcfe3c3c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:21.346801 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-8f91a06f-ec44-45b6-b2e1-26c3fcfe3c3c tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1266 microversion: 2.1 time: 0.160645 Jan 10 11:52:21.347393 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 578/1169] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:21 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:52:22.365224 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-4e709f84-5677-4d7a-84bb-a65cd7394420 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:22.365928 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-4e709f84-5677-4d7a-84bb-a65cd7394420 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:22.373395 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4e709f84-5677-4d7a-84bb-a65cd7394420 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:22.373852 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4e709f84-5677-4d7a-84bb-a65cd7394420 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:22.374682 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4e709f84-5677-4d7a-84bb-a65cd7394420 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:22.375128 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-4e709f84-5677-4d7a-84bb-a65cd7394420 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:22.516844 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-4e709f84-5677-4d7a-84bb-a65cd7394420 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:22.525198 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-4e709f84-5677-4d7a-84bb-a65cd7394420 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1452 microversion: 2.1 time: 0.164441 Jan 10 11:52:22.525913 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 592/1170] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:22 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:52:22.541685 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-0b13cda1-5e08-4307-b734-a15e1e7e12b1 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:52:22.543133 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-0b13cda1-5e08-4307-b734-a15e1e7e12b1 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:52:22.549400 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0b13cda1-5e08-4307-b734-a15e1e7e12b1 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:22.549856 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0b13cda1-5e08-4307-b734-a15e1e7e12b1 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:22.550678 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0b13cda1-5e08-4307-b734-a15e1e7e12b1 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:22.551119 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-0b13cda1-5e08-4307-b734-a15e1e7e12b1 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:22.689167 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-0b13cda1-5e08-4307-b734-a15e1e7e12b1 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:52:22.696840 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-0b13cda1-5e08-4307-b734-a15e1e7e12b1 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1452 microversion: 2.1 time: 0.158810 Jan 10 11:52:22.697440 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 579/1171] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:52:22 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:52:24.872870 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-64f90f53-b7d7-4faf-a91c-d0664898991e req-aabf39ad-463e-4c01-9d07-a98dc106ba37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8bfb8c4-46a9-45ba-84df-68560e051224", "tag": "521c1d4b-4729-4ac8-88a0-48f20ea6c44d"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:52:24.874784 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:52:24.874784 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:52:24.884371 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-64f90f53-b7d7-4faf-a91c-d0664898991e req-aabf39ad-463e-4c01-9d07-a98dc106ba37 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:52:24.884852 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-64f90f53-b7d7-4faf-a91c-d0664898991e req-aabf39ad-463e-4c01-9d07-a98dc106ba37 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:52:24.900583 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-64f90f53-b7d7-4faf-a91c-d0664898991e req-aabf39ad-463e-4c01-9d07-a98dc106ba37 service nova] Creating event network-changed:521c1d4b-4729-4ac8-88a0-48f20ea6c44d for instance d8bfb8c4-46a9-45ba-84df-68560e051224 on hv-cinder-maste Jan 10 11:52:24.906449 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-64f90f53-b7d7-4faf-a91c-d0664898991e req-aabf39ad-463e-4c01-9d07-a98dc106ba37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039927 Jan 10 11:52:24.907084 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 593/1172] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:52:38.887096 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 11:52:38.887772 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: Mon Jan 10 11:52:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 11:52:49.966529 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 11:52:49.967184 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: Mon Jan 10 11:52:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 11:53:53.200207 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-2395f6fc-dd1e-440f-8981-5a882902ce83 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:53:53.200907 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2395f6fc-dd1e-440f-8981-5a882902ce83 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:53:53.203200 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-d4d8fd09-d9f9-4a47-8331-654f93e5ebe7 req-ae4e7b8a-b5be-43d1-a9e0-780ba9766425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8bfb8c4-46a9-45ba-84df-68560e051224", "tag": "521c1d4b-4729-4ac8-88a0-48f20ea6c44d"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:53:53.204992 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:53:53.204992 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:53:53.207246 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2395f6fc-dd1e-440f-8981-5a882902ce83 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:53:53.207644 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2395f6fc-dd1e-440f-8981-5a882902ce83 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:53:53.208934 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2395f6fc-dd1e-440f-8981-5a882902ce83 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:53:53.208934 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-2395f6fc-dd1e-440f-8981-5a882902ce83 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:53:53.214358 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-d4d8fd09-d9f9-4a47-8331-654f93e5ebe7 req-ae4e7b8a-b5be-43d1-a9e0-780ba9766425 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:53:53.216409 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-d4d8fd09-d9f9-4a47-8331-654f93e5ebe7 req-ae4e7b8a-b5be-43d1-a9e0-780ba9766425 service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:53:53.228356 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-d4d8fd09-d9f9-4a47-8331-654f93e5ebe7 req-ae4e7b8a-b5be-43d1-a9e0-780ba9766425 service nova] Creating event network-changed:521c1d4b-4729-4ac8-88a0-48f20ea6c44d for instance d8bfb8c4-46a9-45ba-84df-68560e051224 on hv-cinder-maste Jan 10 11:53:53.234328 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-d4d8fd09-d9f9-4a47-8331-654f93e5ebe7 req-ae4e7b8a-b5be-43d1-a9e0-780ba9766425 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036279 Jan 10 11:53:53.235297 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 594/1173] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:53:53.238101 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-2395f6fc-dd1e-440f-8981-5a882902ce83 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Going to try to terminate instance {{(pid=128718) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:53:53.732596 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-2395f6fc-dd1e-440f-8981-5a882902ce83 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 204 len: 0 microversion: 2.1 time: 0.537087 Jan 10 11:53:53.738630 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 580/1174] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:53:53 2022] DELETE /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:53:53.752074 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-14377004-8920-40b5-af43-aa3c14b5f139 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:53:53.753925 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-14377004-8920-40b5-af43-aa3c14b5f139 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:53:53.766206 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-14377004-8920-40b5-af43-aa3c14b5f139 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:53:53.767814 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-14377004-8920-40b5-af43-aa3c14b5f139 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:53:53.769253 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-14377004-8920-40b5-af43-aa3c14b5f139 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:53:53.770077 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-14377004-8920-40b5-af43-aa3c14b5f139 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:53:54.023842 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-14377004-8920-40b5-af43-aa3c14b5f139 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:53:54.031781 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-14377004-8920-40b5-af43-aa3c14b5f139 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1577 microversion: 2.1 time: 0.289930 Jan 10 11:53:54.032409 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 595/1175] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:53:53 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1577 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:53:55.050942 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-c43b5a54-9d6e-4519-a024-92d6e3aa7bc6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:53:55.051807 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-c43b5a54-9d6e-4519-a024-92d6e3aa7bc6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:53:55.068329 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c43b5a54-9d6e-4519-a024-92d6e3aa7bc6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:53:55.068803 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c43b5a54-9d6e-4519-a024-92d6e3aa7bc6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:53:55.069614 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c43b5a54-9d6e-4519-a024-92d6e3aa7bc6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:53:55.070047 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-c43b5a54-9d6e-4519-a024-92d6e3aa7bc6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:53:55.261418 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-c43b5a54-9d6e-4519-a024-92d6e3aa7bc6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:53:55.269673 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-c43b5a54-9d6e-4519-a024-92d6e3aa7bc6 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1458 microversion: 2.1 time: 0.222801 Jan 10 11:53:55.270294 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 581/1176] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:53:55 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1458 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:53:55.948931 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-bd76e0b7-0d6e-46a7-b8ce-d657c782567e req-760e9808-c204-4a70-a4aa-3e43e117fb5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8bfb8c4-46a9-45ba-84df-68560e051224", "name": "network-vif-deleted", "tag": "521c1d4b-4729-4ac8-88a0-48f20ea6c44d"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:53:55.950813 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:53:55.950813 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:53:55.958644 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-bd76e0b7-0d6e-46a7-b8ce-d657c782567e req-760e9808-c204-4a70-a4aa-3e43e117fb5c service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:53:55.963095 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-bd76e0b7-0d6e-46a7-b8ce-d657c782567e req-760e9808-c204-4a70-a4aa-3e43e117fb5c service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:53:55.971756 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-bd76e0b7-0d6e-46a7-b8ce-d657c782567e req-760e9808-c204-4a70-a4aa-3e43e117fb5c service nova] Creating event network-vif-deleted:521c1d4b-4729-4ac8-88a0-48f20ea6c44d for instance d8bfb8c4-46a9-45ba-84df-68560e051224 on hv-cinder-maste Jan 10 11:53:55.977944 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-bd76e0b7-0d6e-46a7-b8ce-d657c782567e req-760e9808-c204-4a70-a4aa-3e43e117fb5c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032677 Jan 10 11:53:55.978598 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 596/1177] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:53:56.295662 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-bbc97ee8-e9eb-4031-8fa6-18d578020c0f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:53:56.296556 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-bbc97ee8-e9eb-4031-8fa6-18d578020c0f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:53:56.304214 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bbc97ee8-e9eb-4031-8fa6-18d578020c0f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:53:56.304731 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bbc97ee8-e9eb-4031-8fa6-18d578020c0f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:53:56.305626 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bbc97ee8-e9eb-4031-8fa6-18d578020c0f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:53:56.305971 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-bbc97ee8-e9eb-4031-8fa6-18d578020c0f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:53:56.673825 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-bbc97ee8-e9eb-4031-8fa6-18d578020c0f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:53:56.682143 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-bbc97ee8-e9eb-4031-8fa6-18d578020c0f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 200 len: 1225 microversion: 2.1 time: 0.390855 Jan 10 11:53:56.682883 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 582/1178] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:53:56 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 1225 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:53:57.701945 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e7efc428-313c-4962-9f02-9e5bc379906f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:53:57.702731 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-e7efc428-313c-4962-9f02-9e5bc379906f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: d8bfb8c4-46a9-45ba-84df-68560e051224] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:53:57.710438 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e7efc428-313c-4962-9f02-9e5bc379906f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:53:57.715879 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e7efc428-313c-4962-9f02-9e5bc379906f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:53:57.715879 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e7efc428-313c-4962-9f02-9e5bc379906f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:53:57.715879 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-e7efc428-313c-4962-9f02-9e5bc379906f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:53:57.727054 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-e7efc428-313c-4962-9f02-9e5bc379906f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] HTTP exception thrown: Instance d8bfb8c4-46a9-45ba-84df-68560e051224 could not be found. Jan 10 11:53:57.727665 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-e7efc428-313c-4962-9f02-9e5bc379906f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Returning 404 to user: Instance d8bfb8c4-46a9-45ba-84df-68560e051224 could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:53:57.728510 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-e7efc428-313c-4962-9f02-9e5bc379906f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224" status: 404 len: 111 microversion: 2.1 time: 0.032207 Jan 10 11:53:57.729084 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 597/1179] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:53:57 2022] GET /compute/v2.1/servers/d8bfb8c4-46a9-45ba-84df-68560e051224 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 10 11:54:01.249158 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-e5e364bd-56e2-4753-903e-e698199a6328 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:54:01.249824 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e5e364bd-56e2-4753-903e-e698199a6328 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:54:01.250767 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-b6caba74-cc1b-42b2-ac19-c737228864fc req-dad76bea-66f7-462d-a4e4-fb611b28b3cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e70ae1e1-53e5-4a32-9632-bbdbf5be7231", "tag": "16ca642f-40bb-46ee-bbb7-62b2a82d1bf5"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:54:01.252352 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:54:01.252352 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:54:01.257448 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e5e364bd-56e2-4753-903e-e698199a6328 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:01.258244 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e5e364bd-56e2-4753-903e-e698199a6328 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:01.259330 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e5e364bd-56e2-4753-903e-e698199a6328 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:01.259855 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-e5e364bd-56e2-4753-903e-e698199a6328 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:01.262086 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-b6caba74-cc1b-42b2-ac19-c737228864fc req-dad76bea-66f7-462d-a4e4-fb611b28b3cd service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:01.262558 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-b6caba74-cc1b-42b2-ac19-c737228864fc req-dad76bea-66f7-462d-a4e4-fb611b28b3cd service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:01.276691 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-b6caba74-cc1b-42b2-ac19-c737228864fc req-dad76bea-66f7-462d-a4e4-fb611b28b3cd service nova] Creating event network-changed:16ca642f-40bb-46ee-bbb7-62b2a82d1bf5 for instance e70ae1e1-53e5-4a32-9632-bbdbf5be7231 on hv-cinder-maste Jan 10 11:54:01.283523 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-b6caba74-cc1b-42b2-ac19-c737228864fc req-dad76bea-66f7-462d-a4e4-fb611b28b3cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036613 Jan 10 11:54:01.285073 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 598/1180] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 10 11:54:01.289023 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-e5e364bd-56e2-4753-903e-e698199a6328 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Going to try to terminate instance {{(pid=128718) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 10 11:54:01.720550 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-e5e364bd-56e2-4753-903e-e698199a6328 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 204 len: 0 microversion: 2.1 time: 0.475213 Jan 10 11:54:01.721875 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 583/1181] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:54:01 2022] DELETE /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 10 11:54:01.746876 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7d3e51d5-9e4e-44a4-903d-bbbe1846d778 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:54:01.750098 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7d3e51d5-9e4e-44a4-903d-bbbe1846d778 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:54:01.759154 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7d3e51d5-9e4e-44a4-903d-bbbe1846d778 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:01.759879 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7d3e51d5-9e4e-44a4-903d-bbbe1846d778 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:01.761078 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7d3e51d5-9e4e-44a4-903d-bbbe1846d778 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:01.761855 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7d3e51d5-9e4e-44a4-903d-bbbe1846d778 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:01.955721 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-7d3e51d5-9e4e-44a4-903d-bbbe1846d778 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:54:01.969934 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7d3e51d5-9e4e-44a4-903d-bbbe1846d778 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1577 microversion: 2.1 time: 0.231845 Jan 10 11:54:01.970896 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 599/1182] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:54:01 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1577 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 10 11:54:02.998123 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-71cfe1f8-a3d2-41db-b426-398160f1a901 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:54:02.998965 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-71cfe1f8-a3d2-41db-b426-398160f1a901 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:54:03.005331 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-71cfe1f8-a3d2-41db-b426-398160f1a901 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:03.006398 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-71cfe1f8-a3d2-41db-b426-398160f1a901 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:03.007206 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-71cfe1f8-a3d2-41db-b426-398160f1a901 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:03.007665 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-71cfe1f8-a3d2-41db-b426-398160f1a901 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:03.148647 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-71cfe1f8-a3d2-41db-b426-398160f1a901 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:54:03.156348 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-71cfe1f8-a3d2-41db-b426-398160f1a901 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1459 microversion: 2.1 time: 0.162284 Jan 10 11:54:03.156936 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 584/1183] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:54:02 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1459 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:54:04.041938 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [req-8fd6bc03-e69f-4ca3-887c-4eee28243d5a req-3c03e3c6-ded7-4340-9f12-c4df9fd6715d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e70ae1e1-53e5-4a32-9632-bbdbf5be7231", "name": "network-vif-deleted", "tag": "16ca642f-40bb-46ee-bbb7-62b2a82d1bf5"}]} {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 10 11:54:04.043959 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 11:54:04.043959 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: warnings.warn(msg) Jan 10 11:54:04.053521 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-8fd6bc03-e69f-4ca3-887c-4eee28243d5a req-3c03e3c6-ded7-4340-9f12-c4df9fd6715d service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:04.054606 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [req-8fd6bc03-e69f-4ca3-887c-4eee28243d5a req-3c03e3c6-ded7-4340-9f12-c4df9fd6715d service nova] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:04.067680 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.compute.server_external_events [req-8fd6bc03-e69f-4ca3-887c-4eee28243d5a req-3c03e3c6-ded7-4340-9f12-c4df9fd6715d service nova] Creating event network-vif-deleted:16ca642f-40bb-46ee-bbb7-62b2a82d1bf5 for instance e70ae1e1-53e5-4a32-9632-bbdbf5be7231 on hv-cinder-maste Jan 10 11:54:04.074452 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [req-8fd6bc03-e69f-4ca3-887c-4eee28243d5a req-3c03e3c6-ded7-4340-9f12-c4df9fd6715d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039170 Jan 10 11:54:04.075340 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 600/1184] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Jan 10 11:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 10 11:54:04.174550 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-17d17996-8a04-4774-b1e0-d43394ad8f00 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:54:04.175242 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-17d17996-8a04-4774-b1e0-d43394ad8f00 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:54:04.181836 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-17d17996-8a04-4774-b1e0-d43394ad8f00 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:04.182365 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-17d17996-8a04-4774-b1e0-d43394ad8f00 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:04.183171 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-17d17996-8a04-4774-b1e0-d43394ad8f00 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:04.183613 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-17d17996-8a04-4774-b1e0-d43394ad8f00 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:04.256020 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.policy [None req-17d17996-8a04-4774-b1e0-d43394ad8f00 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128718) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:54:04.266354 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-17d17996-8a04-4774-b1e0-d43394ad8f00 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1391 microversion: 2.1 time: 0.095411 Jan 10 11:54:04.268522 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 585/1185] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:54:04 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1391 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:54:05.287528 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-7982af28-895e-42fb-aa44-1bc36d06552f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:54:05.288225 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-7982af28-895e-42fb-aa44-1bc36d06552f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:54:05.295162 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7982af28-895e-42fb-aa44-1bc36d06552f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:05.295614 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7982af28-895e-42fb-aa44-1bc36d06552f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:05.296405 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7982af28-895e-42fb-aa44-1bc36d06552f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:05.296842 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7982af28-895e-42fb-aa44-1bc36d06552f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:05.328349 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7982af28-895e-42fb-aa44-1bc36d06552f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:05.328967 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-7982af28-895e-42fb-aa44-1bc36d06552f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:05.329250 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.objects.instance [None req-7982af28-895e-42fb-aa44-1bc36d06552f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lazy-loading 'fault' on Instance uuid e70ae1e1-53e5-4a32-9632-bbdbf5be7231 {{(pid=128719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 10 11:54:05.369516 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.policy [None req-7982af28-895e-42fb-aa44-1bc36d06552f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa0eed1277c2418ca9f815589ab58896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1d77884a2a4a7ebb85ba71e9d864a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128719) authorize /opt/stack/nova/nova/policy.py:199}} Jan 10 11:54:05.377703 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-7982af28-895e-42fb-aa44-1bc36d06552f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 200 len: 1231 microversion: 2.1 time: 0.094239 Jan 10 11:54:05.386067 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 601/1186] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:54:05 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 10 11:54:06.399079 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4b516a7a-25ea-4952-932c-e6032cf21b0f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:54:06.399778 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-4b516a7a-25ea-4952-932c-e6032cf21b0f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: e70ae1e1-53e5-4a32-9632-bbdbf5be7231] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:54:06.410701 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4b516a7a-25ea-4952-932c-e6032cf21b0f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:06.411518 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4b516a7a-25ea-4952-932c-e6032cf21b0f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:06.413948 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4b516a7a-25ea-4952-932c-e6032cf21b0f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:06.414823 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-4b516a7a-25ea-4952-932c-e6032cf21b0f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:06.440612 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-4b516a7a-25ea-4952-932c-e6032cf21b0f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] HTTP exception thrown: Instance e70ae1e1-53e5-4a32-9632-bbdbf5be7231 could not be found. Jan 10 11:54:06.441514 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-4b516a7a-25ea-4952-932c-e6032cf21b0f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Returning 404 to user: Instance e70ae1e1-53e5-4a32-9632-bbdbf5be7231 could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:54:06.443236 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-4b516a7a-25ea-4952-932c-e6032cf21b0f tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231" status: 404 len: 111 microversion: 2.1 time: 0.050094 Jan 10 11:54:06.444310 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 586/1187] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:54:06 2022] GET /compute/v2.1/servers/e70ae1e1-53e5-4a32-9632-bbdbf5be7231 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:54:07.223655 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f93f4ad4-a98c-46e0-bcbe-a50fba3f9215 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:54:07.224253 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.compute.api [None req-f93f4ad4-a98c-46e0-bcbe-a50fba3f9215 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128719) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:54:07.230835 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f93f4ad4-a98c-46e0-bcbe-a50fba3f9215 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:07.231282 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f93f4ad4-a98c-46e0-bcbe-a50fba3f9215 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:07.232064 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f93f4ad4-a98c-46e0-bcbe-a50fba3f9215 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:07.232583 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG oslo_concurrency.lockutils [None req-f93f4ad4-a98c-46e0-bcbe-a50fba3f9215 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:07.246534 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.wsgi [None req-f93f4ad4-a98c-46e0-bcbe-a50fba3f9215 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] HTTP exception thrown: Instance c47fc785-2072-4e05-9f7b-f95dbc2757d2 could not be found. Jan 10 11:54:07.247128 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-f93f4ad4-a98c-46e0-bcbe-a50fba3f9215 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Returning 404 to user: Instance c47fc785-2072-4e05-9f7b-f95dbc2757d2 could not be found. {{(pid=128719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:54:07.247957 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-f93f4ad4-a98c-46e0-bcbe-a50fba3f9215 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 404 len: 111 microversion: 2.1 time: 0.028401 Jan 10 11:54:07.248506 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 602/1188] 10.222.0.20 () {58 vars in 1238 bytes} [Mon Jan 10 11:54:07 2022] DELETE /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:54:07.256589 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-956ba35e-e157-459e-a6f3-273027643310 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '>' {{(pid=128718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:54:07.257192 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.compute.api [None req-956ba35e-e157-459e-a6f3-273027643310 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] [instance: c47fc785-2072-4e05-9f7b-f95dbc2757d2] Fetching instance by UUID {{(pid=128718) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 10 11:54:07.263396 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-956ba35e-e157-459e-a6f3-273027643310 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:07.263846 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-956ba35e-e157-459e-a6f3-273027643310 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:07.264623 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-956ba35e-e157-459e-a6f3-273027643310 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 10 11:54:07.265054 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG oslo_concurrency.lockutils [None req-956ba35e-e157-459e-a6f3-273027643310 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Lock "b04a23e9-a80a-461f-a3e7-7cc1d42b02ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 10 11:54:07.279437 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.wsgi [None req-956ba35e-e157-459e-a6f3-273027643310 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] HTTP exception thrown: Instance c47fc785-2072-4e05-9f7b-f95dbc2757d2 could not be found. Jan 10 11:54:07.280030 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: DEBUG nova.api.openstack.wsgi [None req-956ba35e-e157-459e-a6f3-273027643310 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Returning 404 to user: Instance c47fc785-2072-4e05-9f7b-f95dbc2757d2 could not be found. {{(pid=128718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 10 11:54:07.280873 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO nova.api.openstack.requestlog [None req-956ba35e-e157-459e-a6f3-273027643310 tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2" status: 404 len: 111 microversion: 2.1 time: 0.028151 Jan 10 11:54:07.282028 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: [pid: 128718|app: 0|req: 587/1189] 10.222.0.20 () {58 vars in 1235 bytes} [Mon Jan 10 11:54:07 2022] GET /compute/v2.1/servers/c47fc785-2072-4e05-9f7b-f95dbc2757d2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 10 11:54:09.098089 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: DEBUG nova.api.openstack.wsgi [None req-fa7769d8-4e8c-434e-8d5b-e2c077b8254b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] Calling method '.version_select at 0x7f477a1f74c0>' {{(pid=128719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 10 11:54:09.202292 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO nova.api.openstack.requestlog [None req-fa7769d8-4e8c-434e-8d5b-e2c077b8254b tempest-TestVolumeBootPattern-1235300116 tempest-TestVolumeBootPattern-1235300116-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1006001352" status: 202 len: 0 microversion: 2.1 time: 0.109693 Jan 10 11:54:09.202900 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: [pid: 128719|app: 0|req: 603/1190] 10.222.0.20 () {58 vars in 1262 bytes} [Mon Jan 10 11:54:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1006001352 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 10 11:54:10.884767 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 11:54:10.885493 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: Mon Jan 10 11:54:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 11:54:13.185495 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 11:54:13.186046 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: Mon Jan 10 11:54:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 11:55:58.895429 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 11:55:58.896027 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: Mon Jan 10 11:55:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 11:56:39.031112 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 11:56:39.031747 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: Mon Jan 10 11:56:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 11:57:30.894712 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 11:57:30.895798 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: Mon Jan 10 11:57:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 11:57:33.197056 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 11:57:33.197669 dv-cinder-master-3-iscsi devstack@n-api.service[128719]: Mon Jan 10 11:57:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 10 11:59:18.904551 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 10 11:59:18.905195 dv-cinder-master-3-iscsi devstack@n-api.service[128718]: Mon Jan 10 11:59:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!